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and  depot  levels  to  maintain  avionics  equipment  and  the  costp 
of  avionics  spares  and  repair  parts  support. 

The  results  of  the  study  are  presented  in  two  volumes. 
Volume  I reviews  and  evaluates  current  methods  used  in 
industry  and  in  the  Air  Force  and  Navy  to  estimate  these 
avionics  support  costs^ reviews  and  evaluates  relevant  Indus 
try  and  defense  st'udTes;  reviews  industry  and  DoD  data  and 
management  systems  that  could  provide  data  needed  for 
avionics  support  cost  estimating  techniques;  discusses  the 
feasibility  of  developing  suitable  estimating  techniques; 
and  presents  recommendations  on  the  best  methods  to  follow 
in  dealing  with  this  cost  estimation  problem  at  DSARC  0,  I, 
and  II.  The  paper  provides  a comprehensive  review  of  the 
DSARC  process.  It  discusses  major  conceptual  problems  in 
developing  es.timates  of  future  support  costs  for  equipment 
still  in  the  early  development  stagesT-^Plnally , the  paper 
concludes  that  it  is  feasible  and  desirable  to  prepare  these} 
estimates  for  avionics  support  costs.  The  specific  method 
to  be  adopted  depends  on  the  amount  of  resources  OSD  wishes 
to  devote  to  this  effort. 


Volume  II  is  a compilation  of  appendixes  containing 
additional  material  to  support  the  basic  report,  including 
summary  evaluations  of  forty-eight  key  documents  encounterec^ 
in  the  literature  search. 


1 ACCESSION  far 

. • 

iim 

NWtil 

Mtall 

DOC 

Mil 

turn  0 

VNANNOUMa 

a 

jusrmiiN 

2 

■umajisatiED 


MCUHITV  CLMSmCATlM  Of  THIS  ^AOirWkM  lniM« 


3 


C 


IDA  PAPER  P-1292 


THE  FEASIBIUTY  OF  ESTIMATING  AVIONICS 
SUPPORT  COSTS  EARLY  IN  THE  ACQUISITION  CYCLE 

Volume  I:  The  Basic  Report 


John  D.  Morgan 
Aaron  B.  Fuller 


September  1977 


ID>1 


INSTITUTE  FOR  DEFENSE  ANALYSES 
COST  ANALYSIS  GROUP 
400  Army-Navy  Drive,  Arlington, Virginia  22202 


» 


Contract  DAHC15  73  C 0200 
Task  DP&E  110 


I 


FOREWORD 


This  paper,  prepared  by  the  Cost  Analysis  Group  of  the 
Institute  for  Defense  Analyses,  reports  on  work  accomplished 
for  the  Director,  Planning  and  Evaluation,  Office,  Secretary  of 
Defense  (OSD/DP&E)  under  Task  Order  DP&E-llO,  January  3,  1977. 


The  objective  of  this  research  was  to  determine  the  feasi- 
bility of  developing  methods  to  estimate,  during  system  acquisi- 
tion, the  support  cost  impact  of  alternative  avionics  components 
envisioned  for  Air  Force  and  Navy  fighter  aircraft.  For  the 
purpose  of  this  study  support  costs  are  defined  as  those  costs 
Incurred  at  the  organizational,  intermediate,  and  depot  levels 
to  maintain  avionics  equipment  and  the  costs  of  avionics  spares 
and  repair  parts  support. 

\ 

Currently,  the  OSD  Cost  Analysis  Improvement  Group  (CAIG) 
lacks  the  capability  to  evaluate  the  sensitivity  of  avionics 
support  costs  to  alternative  avionics  component  designs,  con- 
figurations and  reliabilities.  Moreover,  there  is  considerable 
uncertainty  regarding  the  approach  that  should  be  taken  to 
estimate  these  costs  in  the  early  stages  of  aircraft  system 
development.  Research  under  this  task  was  designed  to  aid  DP&E 
in  deciding  what  action  to  take  to  deal  with  this  problem. 


The  task  involved  the  following  specific  requirements 


(1)  Review  and  evaluate  current  methods  used  in  Industry 
and  by  the  Air  Force  and  Navy  to  estimate  the  support 
costs  of  avionics  equipment  on  operational  aircraft 
systems. 

(2)  Review  and  evaluate  relevant  industry  and  defense 
studies  that  have  addressed  the  problems  of  esti- 
mating support  costs  of  avionics  equipment  prior 


to  operational  deployment  or  may  offer  Insights 
on  how  to  develop  suitable  estimating  techniques. 

(3)  Review  industry  and  DoD  data  and  management  systems 
that  may  provide  information  that  could  be  used  in 
developing  or  applying  estimating  techniques  for 
avionics  equipment  under  consideration  in  the  study. 

(4)  Based  on  research  performed  under  (1)  through  (3), 
determine  the  feasibility  of  developing  methods 

to  estimate  the  support  costs  of  avionics  equip- 
ment during  system  development.  Present  recom- 
mendations on  best  methods  to  follow  in  dealing 
with  this  cost  estimation  problem  at  both  DSARC 
I and  II. 

In  satisfying  the  requirement  of  (1)  above,  IDA  extended 
the  analysis  to  include  a complete  review  of  current  Air  Force 
and  Navy  methods  to  estimate  the  relevant  future  avionics  sup- 
port costs  very  early  in  the  weapon  system  acquisition  cycle. 
Although  knowledge  of  these  methods  exists  throughout  DoD,  this 
paper  documents,  with  relatively  comprehensive  coverage,  the 
existing  Service  state-of-the  art  in  cost  estimating.  Our 
evaluations  also  cover  all  of  these  methods. 

Finally,  we  present  our  views  on  how  OSD  should  address 
the  problem  of  estimating  future  avionics  equipment  support 
costs  when  the  equipment  is  in  the  very  early  stages  of  develop- 
ment . 


Chapter  I of  this  paper  defines  the  areas  of  interest, 
and  the  avionics  equipments  relevant  to  our  research.  It  also 
includes  a description  of  the  roles  and  the  processes  of  the 
Defense  Systems  Acquisition  Review  Council  (DSARC).  Major 
conceptual  problems  exist  in  developing  estimates  of  future 
support  costs  for  equipments  in  the  early  development  stage; 
This  is  particularly  true  for  avionics  equipment.  Therefore, 
Chapter  I discusses  at  some  length  these  conceptual  problems. 
Finally,  we  present  a brief  summary  of  our  review  of  prior 
research  related  to  the  subject  area  of  this  task. 
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Chapter  II  includes  the  descriptions  of  current  Air  Force 
and  Navy  methods  to  estimate  avionics  support  costs  at  all 
stages  of  the  weapon  system  acquisition  cycle.  These  methods 
vary  from  broad  parametric  regression  techniques  using  scanty 
data  and  providing  highly  uncertain  outputs  to  accounting 
methods  that  use  data  relating  to  the  actual  performance  of 
fully  developed  equipments. 

Chapter  III  discusses  the  methods  used  by  defense  contrac- 
tors who  perform  analyses  extending  from  early  feasibility 
studies  to  evaluations  of  future  support  costs  based  on  hard- 
ware in  production.  As  would  be  expected,  some  of  the  most 
significant  cost  estimating  research  has  been  performed  by  con- 
tractors, especially  since  OSD  has  begun  to  place  considerable 
emphasis  in  the  acquisition  process  on  the  impact  of  future 
system  support  costs. 

Chapter  IV  contains  our  evaluations  of  the  Services'  and 
contractors'  estimating  methods.  The  advantages  and  disadvan- 
tages of  the  various  methods  are  well  known  in  the  defense 
community  but,  in  this  chapter,  we  attempt  to  focus  on  charac- 
teristics and  capabilities  of  these  methods  as  related  speci- 
fically to  avionics.  The  technological  content  and  rate  of 
technological  change  are  very  significant  in  avionics  and  these 
elements  Introduce  special  problems  in  support  cost  estimating 
for  this  kind  of  equipment.  We  discuss  the  implications  of 
these  characteristics. 

Chapter  V discusses  modeling  approaches  that  should  be  con- 
sidered by  OSD  in  addressing  the  avionics  support  cost  estimat- 
ing problem.  Six  methods  are  discussed  with  identification  of 
special  characteristics  that  OSD  should  consider  in  determining 
which  methods  might  best  fit  their  needs. 

Chapter  VI  contains  our  conclusions  on  the  feasibility  of 
developing  methods  to  estimate  the  support  costs  of  avionics 
equipment  during  system  development.  In  summary,  we  conclude 
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that  It  Is  feasible  and  desirable  to  prepare  these  estimates. 

The  specific  method  to  be  adopted  depends  on  the  amount  of 
resources  OSD  wishes  to  devote  to  this  effort.  This  decision, 
of  course,  should  relate  to  the  degree  of  importance  OSD  chooses 
to  attach  to  the  support  cost  variables  versus  other  variables 
such  as  performance  in  selecting  among  alternative  major  systems 

The  appendixes  of  this  paper  contain  extracts  of  directives 
summaries  of  prior  research  documents,  and  details  on  various 
support  cost  estimating  methodologies. 

Periodic  reviews  and  critiques  of  IDA*s  work  were  performed 
by  a Technical  Review  Board  (TRB)  composed  of  Mr.  J.J.  Bussolini 
Grumman  Aerospace  Company,  Dr.  Steve  Dresner  and  Mr.  Hyman 
Schulman  of  the  RAND  Corporation,  and  Dr.  C.  David  Weimer,  IDA 
Cost  Analysis  Group.  We  appreciate  the  constructive  comments 
and  recommendations  of  the  Technical  Review  Board. 


EXECUTIVE  SUMMARY 


A.  THE  INSTITUTE  FOR  DEFENSE  ANALYSES  TASK 

The  Director  of  Planning  and  Evaluation  In  the  Office  of 
the  Secretary  of  Defense  asked  IDA  to  ascertain  the  feasibility 
of  developing  methods  to  estimate  the  future  support  costs  of 
avionics  equipments  on  proposed  fighter  aircraft  while  the  air- 
craft are  still  being  planned  and  developed.  As  a general 
definition,  avionics  refers  to  radios,  radars,  computers, 
antennas,  pulse  analyzers  and  other  airborne  electronics  equip- 
ments that  perform  the  specific  aircraft  functions  shown  In 
Table  S-1. * Support  costs  In  this  paper  refer  to  maintenance 
costs  at  the  organization.  Intermediate,  and  depot  levels  and 
to  the  costs  of  spares  and  repair  parts. 

The  paper  presents  the  following  research  results: 

(1)  It  reviews  and  evaluates  current  Navy,  Air  Force, 
and  Industry  methods  used  to  estimate  the  support 
costs  of  avionics  equipment  on  operational  aircraft. 

(2)  It  reviews  and  evaluates  relevant  Industry  and 
defense  studies  that  have  addressed  the  problems 
of  estimating  avionics  support  costs  during  the 
acquisition  process  prior  to  operational  deploy- 
ment . 

(3)  It  reviews  relevant  DoD  and  Industry  data  and 
management  Information  systems  that  can  provide 
Information  useful  to  avionics  support  cost  esti- 
mates during  the  acquisition  cycle. 


‘iVo-dlglt  Vfork  Unit  Codes  (WUC's)  such  as  those  In  Table  S-1  Identify  basic 
functions  that  are  perforrod  on  aircraft.  The  WUC  system,  defined  In 
MILSTD  780,  IS  the  coding  structure  for  Identifying  equipment  to  mainte- 
nance actions  performed  at  the  crgEuilzatlon  and  Intermediate  levels  in 
the  Services. 
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Table  S-1 . 


AVIONICS  COMPONENT  EQUIPMENT  CATEGORIES  IN  THE  DOD 
TWO-DIGIT  WORK  UNIT  CODE  (WUC)  SYSTEM 


Work 

Uni  t 
Code 

Avionics  Component  Equipment  Category 

51 

Instruments 

52 

Autopilot 

53 

Guidance  Systems  (Drone) 

54 

Telemetry  System 

55 

Inflight  Recording  System 

56 

Flight  Reference 

57 

Integrated  Guidance  and  Flight  Control 

58 

Inflight  Test  Equipment 

59 

Target  Scoring  and  Augmentation 

61 

HF  Communications  System 

62 

VHF  Communications  System 

63 

UHF  Communications  System 

64 

Interphone  System 

65 

IFF  Systems 

66 

Emergency  Radio 

67 

Integrated  COM-NAV-IFF  Packages 

69 

Miscellaneous  Communications 

71 

Radio  Navigation 

72 

Radar  Navigation 

73 

Bombing  Navigation 

74 

Weapons  Control 

75 

Weapons  Delivery 

76 

Electronic  Countermeasures 

(4)  It  affirms  the  feasibility  of  developing  methods  to 
estimate  avionics  support  costs  during  weapon  system 
development  prior  to  operational  deployment.  Based 
on  this  feasibility  determination.  It  recommends 
methods  for  OSD  to  consider  for  the  development  of 
an  OSD-level  avionics  component  support  costing 
capability. 


B.  BACKGROUND 

The  costs  of  supporting  a modern  fighter  aircraft  through- 
out Its  operational  life  have  become  large  relative  to  the 
aircraft's  acquisition  cost.  Because  the  largest  share  of 

I 

support  cost  dollars  are  spent  to  maintain  components  and  to 
! buy  component  spares  and  repair  parts,  those  support  cost 

I categories  have  become  Items  of  Interest  to  DoD  decision-makers 

responsible  for  the  acquisition  of  new  weapon  systems  like 
fighter  aircraft.  In  order  to  recognize  and  consider  these 
support  costs  In  planning,  developing,  and  acquiring  a new 
weapon  system,  estimates  of  these  costs  are  required  at  the 
appropriate  decision  milestones. 

The  appropriate  milestones  seem  to  be  those  that  occur  In 
the  early  development  stages  of  a new  fighter  aircraft  program. 

Including  the  Informal  conceptual  study  milestone  and  the  formal 
program  Initiation  and  the  validation  and  demonstration  mile- 
stones. All  of  these  milestones  occur  prior  to  the  source 
selection  decision  when  the  military  Service  source  selection 
authority  decides  which  of  the  competing  commercial  firms  will 
be  funded  to  build  prototype  aircraft  for  full  scale  engineering 
development  testing.  Currently  the  contractors  do  not  present 
to  the  Services,  and  the  Services  do  not  present  to  OSD,  esti- 
mates of  the  support  costs  for  Individual  avionics  components 
before  the  source  selection  decision.  But  by  the  time  the 
source  selection  decision  Is  made,  many  of  the  engineering 
support  and  design  decisions  have  been  made  that  will  determine 
the  costs  of  supporting  the  component  equipments  when  the  air- 
craft becomes  operational.  Some  contractors  estimate  that  as 

much  as  70%  to  80$  of  the  total  life  cycle  costs  of  an  air-  ' 

1 

craft  are  determined  by  the  decisions  made  prior  to  source 
selection.  The  conclusion  Is  that  the  Importance  of  these  j 

[ early  decisions  dictates  that  OSD  have  new  support  cost  estl-  | 

I ' mating  capabilities  appropriately  designed  to  fit  the  needs 

of  decision-makers  at  each  system  acquisition  milestone. 
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Given  this  requirement,  we  conducted  our  research  on  the 
assumptions  that  OSD  requires  both  an  independent  estimating 
capability  to  validate  component  support  cost  estimates  pre- 
sented to  it,  and  an  independent  trade-off  study  capability  to 
compare  the  costs  of  alternative  equipments  that  could  fulfill 
a given  functional  capability  on  a proposed  aircraft.  In  order 
to  determine  the  feasibility  of  developing  methods  to  provide 
these  estimates,  it  was  necessary  to  understand  the  Service 
and  contractor  component  support  cost  estimating  capabilities. 

C.  SERVICE  AND  CONTRACTOR  AVIONICS  COMPONENT  SUPPORT  COST 

ESTIMATING  CAPABILITIES 

The  cost  estimating  methodologies  available  to  the  Services 
and  contractors  Include 

(1)  engineering  ”bottoms-up” 

(2)  analogy  with  existing  systems 

(3)  accounting  add-up 

(4)  simulation 

(5)  parametric  regression 

(6)  subjective  expert  Judgments. 

The  Services  especially  rely  on  accounting  add-up  models  and 
parametric  regressions,  while  the  contractors  may  use  all  of 
the  approaches  throughout  a development  program.  The  con- 
tractors place  particular  emphasis  on  analogies  to  existing 
systems,  engineering  bottoms-up  pricing,  and  the  subjective 
expert  Judgments  of  their  design  and  support  engineering  per- 
sonnel. 

A good  example  of  the  Services*  accounting  model  approach 
is  provided  by  the  Air  Force  Logistics  Command  Logistic  Support 
Cost  (LSC)  Model.  Using  nearly  one  hundred  different  input 
variables  for  each  piece  of  component  equipment,  the  model 
calculates  costs  in  ten  support  categories  including  spares 
(initial  and  replenishment)  and  maintenance  (field  and  depot). 


The  equation  to  calculate  "on-equlpment”  maintenance  costs  at 
the  field  organization  and  Intermediate  levels  Is  shown  In 
Figure  S-1.  As  can  be  seen  In  this  typical  accounting  equation 
structure,  values  for  both  contractor-furnished  Inputs  (MTBP, 
RMH,  RIP,  IMH,  PAMH,  QPA)  and  government-furnished  Inputs  (TPPH, 
UP,  BLR,  SMI)  are  combined  In  simple  algebraic  expressions  that 
permit  the  support  cost  per  unit  of  equipment  to  be  calculated 
and  then  summed  for  the  number  of  units  of  equipment  required.* 
This  Is  the  essence  of  the  accounting  approach,  and  It  Is 
reflected  In  this  Air  Force  LSC  model  as  well  as  the  Navy's 
Equipment  Life  Cycle  Cost  Model,  the  Cost  Reduction  Is  Every- 
one's Responsibility  (CRIER)  Model,  and  other  accounting  models 
that  we  examined. 

The  parametric  regression  approach  Is  usually  used  by  the 
Services  to  estimate  total  aircraft  support  costs  and  the  sup- 
port costs  of  the  three  basic  aircraft  elements,  the  alrfrsune, 
engine,  and  avionics.  These  aggregate  high  level  estimates  can 
then  be  allocated  or  factored  to  Individual  components  such  as 
avionics  equipments.  The  Navy  most  recently  has  used  this 
approach  for  Its  F-l8  development  program.  A typical  equation 
calculates  the  component  rework  cost  per  flying  hour  as  shown 
below: 

CRC  - 105.673  + 31.918[0.7^»(AP)  + (AV+PROP)]  + 8.4i»5 

FW 

^Mfiibp^  " 0-053916  . 

CRC  ■ component  rework  cost  per  flying  hour 

AF  * airframe  flyaway  cost 

AV  ■ avionics  flyaway  cost 

PROP  ■ propulsion  flyaway  cost 

EW  » empty  weight 

MPHBP  ■ mean  flight  hours  between  failure 

V-.,  ■ maximum  aircraft  velocity 

max 

* Itie  acronyms  in  parenthesis  are  spelled  out  in  Figure  S-1. 
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The  equation  was  developed  from  historical  cost  and  aircraft 
characteristics  data  on  nine  Navy  aircraft.  The  calculated 
result  for  the  estimated  P-l8  values  of  the  variables  was  a 
component  rework  cost  of  $200  per  flying  hour.  This  $200  was 
then  allocated  to  various  equipment  components  on  the  basis  of 
factors  derived  from  the  component  rework  cost  experience  on 
the  most  similar  existing  Navy  aircraft.  It  must  be  stressed 
that  these  allocations  of  costs  to  components  were  used  only 
by  the  Navy  as  an  internal  Navy  method  for  establishing  a 
baseline  against  which  contractor  reported  costs  could  be 
compared.  The  baseline  itself  was  never  intended  as  an  esti- 
mate of  actual  component  support  costs.  It  is  of  Interest  to 
us  because  it  highlights  the  fact  that  parametric  regression 
equations  for  the  support  costs  of  individual  components  are 
not  currently  used  by  the  Services.  Instead,  individual  com- 
ponent costs  are  factored  or  allocated. 

Costs  calculated  with  the  Air  Force  LSC  equations  and  the 
Navy  parametric  regression  equations  are  currently  presented 
for  Service  source  selection  decisions  and  for  OSD  full-scale 
engineering  development  decisions.  But  prior  to  these  stages 
of  the  acquisition  process  these  equations,  which  represent 
the  state-of-the-art  in  Service  component  support  cost  esti- 
mating, are  not  presented  to  OSD  for  evaluation. 

Contractor  component  cost  estimating  capabilities  are 
firmly  grounded  in  the  cumulative  engineering  experience  of 
the  various  airframe  and  avionics  firms.  As  shown  in  Table  S-2, 
the  common  sequence  of  contractor  avionics  component  support 
cost  estimating  procedures  is  iterative,  involving  detailed 
engineering  Judgements  of  the  design  and  reliability  and  main- 
tainability Impacts  on  support  costs.  Because  these  Judgments 
are  based  on  real  world  experience  with  the  fundamental  cost 
drivers  as  they  relate  to  equipment  design,  the  contractors 
have  the  basic  knowledge  to  apply  to  any  and  all  of  the  six 
basic  cost  methodologies  listed  earlier. 
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'A  First  Line  Unit  (FLU)  Is  the  first  level  of  assembly  below  the  two-digit  Work  Un 
•t  base  level.  It  Is  usually  the  highest  level  of  assembly  that  Is  removed  and  r«| 
equipment  to  an  operational  condition.  A lower  level  sub-assembly  within  a FLU.  ci 
at  Intermediate  level  shops  Is  not  defined  as  a FLU. 

*The  term  RIP^,  repaired  in  place.  Is  a number  giving  the  fraction  of  failed  FLU'S  i 
fraction  of  failed  FLU's  not  repaired  In  place. 

*The  variables  In  this  bracketed  term  constitute  the  weighted  average  on-equipment  i 
and  access  time  and  cither  In-place  repair  or  removal  and  replacement. 


Figure  S-I.  Oh-EQUIPNENT  HAIMTEMAIICE  COST  EQUATION  IN  THE  AFLC  LOi 

S- 


C2  * cost  of  on-equipment  FLU*  maintenance  « C2^  C22 

Where:  • manhour  cost  to  perform  on-equipment  (flight  line)  m 

system  life. 

C22  ” manhour  cost  to  perform  scheduled  maintenance  on  the: 


(TFFH)(CPA^)(UF^)  + (RIP.)(IMH.)  ♦ ( 1 -RIP. ) (RNH^ 

I I ■ 1 I 1 I 1 I 111 


MTBF 


L 

— ► Fractlor 


Li-i-On-tlme  corrective) 
Fraction  of  failed  FLU's 
— »In-p1ace  preparation  and  atcess' 
Ratio  of  operating  to  flying  hours 
Number  of  like  FLU's  In  parent  syst«( 
Mean  time  between  failure 
Total  force  flying  hours 
Total  number  of  FLU's  In  system 


-TFFH 


(SNH)(BLR) 


ILR) 


Base  labor  rate 

Average  manhours  to  perform  scheduled  perl 
Flying  hour  Interval  between  scheduled  pe 
Total  force  flying  hours 


/ 


1 ^22 

»nt  (flight  line)  maintenance  on  FLU's  due  to  unscheduled  failures  over  the 
maintenance  oh  the  complete  system  over  the  life  cycle. 


+ (1-RIP^)(RMH^)](BLR) 

I — ^Base  labor  rate 

>— »>Average  manhours  to  fault  Isolate,  remove  and  repair 
— ►Fraction  of  failed  FLU's  repaired  in  place* 

►On-time  corrective  maintenance  manhours 
ion  of  failed  FLU's  repaired  in  place 

paration  and  atcess  manhours  ^ 

g to  flying  hours 
U's  in  parent  system 
failure 
g hours 

LU's  in  system 


Form  scheduled  periodic  or  phased  inspection 
ween  scheduled  periodic  or  phased  inspection 
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the  two-digit  Work  Unit  Code  (WUC)  equipment  level  that  is  carried  as  a line  item  of  supply 
t is  removed  and  replaced  on  the  complete  system  or  sub-system  in  order  to  return  the 
ly  within  a FLU,  called  a Shop  Replaceable  Unit  (SRU),  that  is  repaired  or  replaced  only 

tion  of  failed  FLU's  repaired  in  place.  The  complete  term  1-RIP^,  is  a number  giving  the 

average  on-equipment  maintenance  manhours  per  failure  of  the  i^*'  FLU  including  preparation 
lacement. 


N IN  THE  AFLC  LOGISTIC  SUPPORT  COST  MODEL 
3-7/8° 


Table  S-2. 


COMMON  SEQUENCE  OF  CONTRACTOR  AVIONICS  SUPPORT 
ANDMlIoAnONSfAslr"'"'  COHCEATUAL 


Step 

Type  Firm 

Cost  Estimating  Activity 

1 

Aircraft  Prime  Contractor 

Uses  analogy  or  parametric 
regressions  to  estimate  avion- 
ics support  costs  as  a single 
lump,  not  broken  out  by  pieces 
of  equipment. 

2 

Aircraft  Prime  Contractor 

Requests  acquisition  and 
support  cost  estimates  and 
support  parameters  such  as 

MTBF  for  types  of  equipment 
from  avionics  producers. 

3 

Avionics  Equipment 

Producer 

N 

Engineering  bottoms-up  or 
analogy  estimates  of  acquisi- 
tion and  support  costs  and 
support  parameters  such  as 

MTBF  for  specific  equipments, 
reported  to  prime  contractor. 

4 

Aircraft  Prime  Contractor 

-■ 

Uses  accounting  build-up  or 
parametric  estimates  with 
avionics  equipment  producers 
estimates  and  support 
parameters  as  Inputs. 

5 

Avionics  Equipment 

Producer 

Uses  aircraft  prime  contractor 
total  aircraft  weapon  system 
estimates  as  inputs  to  modify 
analogy  and  engineering  esti- 
mates, reports  up-dated  esti- 
mates to  aircraft  prime 
contractor. 

6 

Both  Avionics  Equipment 
Producer  and  Aircraft 

Prime  Contractor 

Continue  to  iterate  cost  models 
by  inputting  each  other's  up- 
dated data  and  reporting 
iterations  to  each  other.  In 
this  process,  all  cost  esti- 
mating methodologies  may  inter- 
act through  iterative  processes. 
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Contractor  misgivings  about  the  development  of  OSD-level  | 

avionics  component  support  cost  < stlmatlng  capabilities  Include  ^ 

doubts  about  the  utility  of  the  i esultlng  cost  estimates  to  OSD  J 

and  the  Services,  and  concerns  tl  at  early  conceptual  stage  cost  I 

estimates  might  become  hard  numbers  to  which  the  contractors 
would  be  expected  to  manage. 

Current  study  contracts  between  the  Air  Force  Avionics 
Laboratory  and  Westlnghouse  Electric  Corporation  and  the  Air 
Force  Flight  Dynamics  Laboratory  and  Grumman  Aerospace  Corpora-  j 

tlon  provide  examples  of  the  applications  of  engineering  experi- 
ence and  expertise  to  component  support  cost  estimating.  Both 
contracts  seek  to  develop  parametric  equations  that  can  estimate 
component  support  costs  In  the  relevant  categories  Including 
maintenance  at  all  levels  and  speres  and  repair  parts.  Our 
discussions  with  the  Westlnghouse  and  Grumman  personnel  reveal  v 
that  their  fundamental  approaches  are  similar  In  that  they  rely 
on  their  In-house  design  and  reliability  and  maintainability 
experts  to  assess  the  relevant  cost  drivers  that  lie  behind 
component  support  costs.  The  major  difficulty  faced  In  both 
contracts  lies  in  the  gathering,  processing,  and  understanding 
of  the  historical  support  costs  and  aircraft  characteristics 
data.  This  Is  Important  because  It  suggests  that  the  basic 
methodology  for  component  support  cost  estimating  exists.  What 
Is  required  Is  an  adequate  data  base. 

D.  DATA  SYSTEMS 

Service  component  support  cost  data  systems  are  designed 
for  the  management  of  resources,  not  for  the  accumulation  of 
consistent  cost  data  that  can  provide  the  bases  for  support 
cost  analyses  In  the  various  methodological  approaches.  This 
situation  Is  changing  with  the  development  of  data  reporting 
systems  like  the  Visibility  of  Management  and  Support  Cost 
(VAMOSC)  systems  In  the  Air  Force  and  Navy.  The  Air  Force’s 
Operating  and  Support  Cost  Estimating  Reference  (OSCER)  system 
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does  not  yet  provide  cost  visibility  to  the  component  level, 
but  a component  cost  companion  system  to  OSCER  is  under  develop- 
ment. The  Naval  Air  Logistics  Command  Management  Information- 
Operating  and  Support/Vlslblllty  and  Management  of  Support  | ’ 

Cost-Air  (NALCOMIS-O&S/VAMOSC-AIR)  data  system  has  a Maintenance 
Subsystem  that  reports  component  equipment  costs  in  the  cate-  j ] 

gories  shown  in  Table  S-3.  Based  on  actual  field  and  depot  ! ! 

i • 

cost  data,  the  NALCOMIS  Maintenance  Subsystem  promises  to  pro- 
vide the  detailed  support  cost  visibility  necessary  to  success-  | 

fully  Implement  existing  component  cost  methodologies  in  the  | 

Services  and  contractors. 

E.  FEASIBLE  MODELING  APPROACHES  FOR  THE  OSD-LEVEL  I j 

Based  on  our  examination  and  analysis  of  Service  and  con-  ; ' 

tractor  methodologies,  current  work  underway  to  refine  these 
methodologies,  and  currently  emerging  data  information  systems, 
we  concluded  that  is  is  feasible  to  develop  methods  for  avionics 
component  support  cost  estimating  at  the  OSD-level.*  Table  S-4 
identifies  six  major  approaches  as  logical  alternatives  for  an 

1 

OSD-level  capability,  and  narrows  to  four  those  that  are  most  | 

feasible.  j 

The  bottoms-up  and  accounting  approaches  most  widely  used 
by  the  Services  and  contractors  are  rejected  as  infeasible  I 

because  of  their  extremely  large  data  input  requirements  at 
very  detailed  levels.  These  may  be  viewed  as  logical  alterna-  , 

tlves  that  are  rejected  because  their  Implementation  effectively  j 

requires  duplication  of  the  extensive  Service  and  contractor  I 

capabilities. 

i 

The  four  feasible  model  approaches  may  be  viewed  as 
approximations  to  and  substitutes  for  the  detailed  expertise 

! 

--  ---  ■ ■■■  I 

‘This  paper  did  not  address  the  subject  of  inplementatlon  of  the  reconrnaidBd  i 

alternative  models.  Estimates  of  the  cost  of  inplementatlon  are  therefore  j 

beyond  the  scope  of  this  paper.  j 

t » 
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Table  S-3.  COST  ELEMENTS  IN  THE  NAVY  VAMOSC-AIR  MS  REPORT 


Level  of  Detail 

Cost  Categories 

Organization  costs  at 

2-digit  Work  Unit  Code 

Level  of  Detail 

MAINTENANCE 

Labor  scheduled 

Labor  unscheduled 

Consumables  scheduled 
Consumables  unscheduled 

SUPPDRT  LABOR 

TECHNICAL  DIRECTIVE  COMPLIANCE 
LABOR 

Intermediate  costs  at 

2-digit  Work  Ur^t  Code 

Level  of  Detail 

MAINTENANCE 

Labor  scheduled 

Labor  unscheduled 

Consumables  scheduled 
Consumables  unscheduled 

SUPPORT  LABOR 

TECHNICAL  DIRECTIVE  COMPLIANCE 
LABOR 

ATTRITION 

Depot  costs  at  2-d1g1t 

Work  Unit  Code  Level  of 

Detail 

COMPONENT  REPAIR  ACTIONS 

NARF 

Direct  labor 

Indirect  labor 

Material 

Commercial 

SURVEYED  REPAIRABLES 

TECHNICAL  DIRECTIVE  COMPLIANCE 
LABOR 

Costs  reported  only  as 
sums  for  entire  aircraft, 
not  for  each  2-dig1t  Work 

Unit  Code 

PRE-EXPENDED  MATERIAL 

ORGANIZATIONAL  SUPPORT  LABOR 

TECHNICAL  DIRECTIVE  COMPLIANCE 
MATERIAL  COSTS 

Organization 

Intermediate 

Depot 

Table  S-4 


SUMMARY 


Model 

Type 

Existing  Examples 

Red 

Analytiq 

Estimation  Model  1 

Bottoms-up  and  Analogy 

Basic  contractor 
approach  after 

DSARC  0 

Initial  anl 
engineer! nl 
a continual 
model  is  bi| 

Estimation  Model  2 

Traditional  regression 
approach  with  acquisi- 
tion cost  as  one  of  a 
few  independent 
variables 

GRC  models 

Initial  anl 
existing  h| 
base 

— — 1 

Estimation  Model  3 

Regression  and  Bottoms- 
up  analogy  combined 

Some  contractor 
research  being  done 
to  develop  such 
models 

Initial  en 
analysis  a 
continual 
support  in 
data  base 

Estimation  Model  4 

Accounting  and  Analogy 

AFLC  LSC,  Navy  LCC, 
CRIER 

Analy ti cal 
process  ma 
inputs 

Estimation  Model  5 

Regression 

None 

Initial  an 
to  work  hi 
base 

Estimation  Model  6* 

Proprietary  Regres- 
sion (RCA  PRICE) 

RCA  PRICE-L 

Initial  tr 

operator, 

required 

♦The  RCA  PRICE  model  alternative  differs  from  the  other  alternatives  in  that  the  equations  are 
relationships  in  the  equations. 


SUMMARY  OF  SUGGESTED  MODELING  APPROACHES  FOR  OSD-LEVEL 


Required 

Analytical  Support 

Lowest  Level  of 

Detail  In  Model 

Useful  for  Point  or 
Trade-Off  Cost  Estimates 

Feasibility  foi 

tial  analysis  and  then 
ineering  judgments  on 
ontlnual  basis  while 
el  Is  being  utilized 

7-D1g1t  WUC  Equipments 

Point  and  Trade-off 

Not  feasible  - 

! 

tial  analysis  of 
sting  historical  data 
e 

2-01g1t  WUC  Equipments 

Point 

Feasible  after 
research  to  de 
suitable  data 
equations 

tial  engineering 
lysis  and  then 
tinual  engineering 
port  Input  to  update 
a base 

7-D1g1t  WUC  Equipments 

Point  and  Trade-off 

Feasible  after 
research  to  do 
suitable  data 
equations 

lytical  support  to 
cess  massive  data 
uts 

7-D1g1t  WUC  Equipments 

Point  and  Trade-off 

Not  feasible  - 

tial  analytical  effort 
work  historical  data 
>e 

2-D1g1t  WUC  Equipments 

Point  and  Trade-off 

Feasible  eftei 
the  basic  modi 

tial  training  of  model 
rator,  same  operator 
ulred  to  Input  data 

7-D1g1t  WUC  Equipments 

Point  and  Trade-off 

Feasible  but  i 
outputs  very  i 

ons  are  unknoMn  to  the  model  user.  Oivly  RCA  kno*»s  the  equations.  This  prohibits  the  user  from  assessing  the 
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Beling  approaches  for  OSD-level 


Lowest  Level  of 

Detail  In  Model 

Useful  for  Point  or 
Trade-Off  Cost  Estimates 

Feasibility  for  use  at  OSD 

7-Dig1t  VlUC  Equipments 

Point  and  Trade-off 

Not  feasible  - too  detailed 

2-Dig1t  WUC  Equipments 

Point 

Feasible  after  initial 
research  to  develop 
suitable  data  base  and 
equations 

7-D1git  WUC  Equipments 



Point  and  Trade-off 

Feasible  after  initial 
research  to  develop 
suitable  data  base  and 
equations 

7-D1g1t  Hue  Equipments 

Point  and  Trade-off 

Not  feasible  - too  detailed 

2-01g1t  WUC  Equipments 

Point  and  Trade-off 

Feasible  after  establishing 
the  basic  model 

7-01g1t  HUC  Equipments 

to— 

Point  and  Trade-off 

Feasible  but  validity  of 
outputs  very  uncertain 

per. 


Oi>ly  RCA  knoMs  the  equations.  This  prohibits  the  user  from  assessing  the  functional 


approach  is  Model  2 In  Table  S-4,  the  traditional  regression 
approach  with  acquisition  cost  of  the  equipment  as  an  independent 
variable.  Based  on  newly  emerging  VAMOSC  data,  equations 
developed  along  traditional  lines  may  provide  acceptable  point 
estimates  of  avionics  component  support  costs  that  could  be 
used  to  validate  estimates  submitted  by  the  Services.  However, 
it  is  unlikely  that  such  equations  will  be  sensitive  to  design 
differences  between  alternative  equipments,  so  other  methodol- 
ogies are  required  to  provide  a trade-off  estimating  capability. 


The  RCA  PRICE  models  provide  a component  support  cost 
trade-off  capability,  but  require  a blind  acceptance  of  pro- 
prietary equations  that  are  not  revealed  to  the  user.  A better 
alternative  in  terms  of  visible  equations  is  represented  by 
Model  3 in  Table  S-4,  a combination  of  regression  and  bottoms-up 
analogy  approaches.  The  procedure  would  be  first  to  establish 
an  avionics  data  base  that  contains  physical  data  characteristics 
of  avionics  equipments — size,  weight,  number  of  parts,  and  so 
on.  Through  a data  system  like  the  Navy  NALCOMIS  Maintenance 
Subsystem,  the  next  step  would  be  to  accumulate  detailed  cost 
data  for  these  equipments.  Given  these  phys5 cal  and  cost 
characteristics  of  avionics  equipments,  it  becomes  possible  to 
run  regressions  on  selected  pieces  of  avionics  equipments  with 
organization,  intermediate,  and  depot  level  maintenance  costs, 
and  replenishment  spares  costs  as  dependent  variables,  and 
physical  equipment  characteristics  as  independent  variables. 


To  use  this  approach  as  a regression  analogy  data  base, 
the  following  procedure  is  possible.  Assume  a new  F-X  aircraft 
is  to  have  an  avionics  suite  composed  of  equipments  that  can 
perform  identifiable  avionics  functions.  Take  an  equipment 
function  such  as  radio  navigation,  and  have  an  engineer  or 
other  knowledgable  person  select  various  equipments  from  the 
data  base  that  are  closest  analogies  to  the  P-X  equipment. 
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The  support  costs  for  these  analogy  equipments  can  be  extracted 
from  the  data  base  and  regressions  can  be  run.  By  combining 
analogies  selected  by  engineers  or  other  experts,  a set  of 
parametric  equations  can  be  tailored  to  the  requirements  of  the 
new  F-X  aircraft.  This  tailoring  feature  provides  a flexible 
methodology.  Each  time  a new  F-X  aircraft  is  proposed,  a new 
set  of  closest  analogy  regression  equations  can  be  extracted 
from  the  data  bases.  Such  a tailored  regression  analogy 
approach  could  provide  both  point  and  trade-off  estimating 
capabilities . 

IDA  concludes  that  it  is  technically  feasible  and  desirable 
for  OSD  to  possess  a capability  for  independent  estimates  of 
avionics  support  costs.  The  most  suitable  method  would  com- 
bine regression  ana-iysls  and  analogy  but  an  approach  based 
only  on  regression  analyses  could  be  adopted. 
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Chapter  I 
INTRODUCTION 

This  paoer  presents  the  results  of  Institute  for  Defense 
Analyses  (IDA)  research  on  methods  to  estimate,  early  in  the 
acquisition  cycle,  the  future  support  costs  that  can  be  expec- 
ted for  fighter  aircraft  avionics  equipment  when  the  aircraft 
become  operational.  Specifically,  the  research  addresses  the 
question  of  whether  it  is  feasible  to  develop  cost  estimating 
methods  that  will  produce  results  useful  in  OSD  decision-making 
while  avionics  components  are  either  not  clearly  defined  or  are 
in  the  very  early  stages  of  development.  Support  costs  are 
defined  as  those  costs  Incurred  at  the  organizational,  inter- 
mediate, and  depot  levels  to  maintain  avionics  equipment  and 
the  costs  of  avionics  spares  and  repair  parts  support. 

The  IDA  research  was  designed  to  support  the  work  of  the 
OSD  Cost  Analysis  Improvement  Croup  (OSD/CAIC).  At  the  time 
of  this  study  the  CAIC  lacked  the  capability  to  evaluate  for 
the  Defense  Systems  Acquisition  Review  Council  the  sensitivity 
of  support  costs  to  alternative  avionics  component  designs, 
configurations,  and  reliabilities.  Moreover,  there  was  con- 
siderable uncertainty  regarding  the  approach  that  should  be 
taken  in  developing  methods  for  estimating  these  costs  in  the 
early  stages  of  aircraft  system  development. 

In  the  following  chapters  we  initially  review  the  methods 
currently  used  by  the  Air  Force  and  Navy  to  estimate  future 
support  costs  for  fighter  aircraft  avionics  equipment.  Then 
we  examine  the  techniques  used  by  contractors  to  develop  these 
kinds  of  estimates.  Included  In  our  reviews  are  discussions 


1 


terns  that 


r 

I 


of  the  DoD  and  contractor  data  and  management  syctems  that 
could  be  used  in  developing  or  applying  cost  estimating  tech- 
niques. Our  review  is  limited  to  the  time  period  that  ends 
with  the  operational  deployment  of  the  aircraft. 


After  these  reviews  of  methods  we  present  a comparison 
and  evaluation  of  these  methods  in  terms  of  their  ability  to 
satisfy  CAIG  needs.  Then  we  present  some  simple  models  for 
comparison  of  avionics  equipment  alternatives.  Some  of  these 
models  could  be  used  pending  the  development  of  more  compre- 
hensive techniques  for  estimating  support  costs. 

Finally,  we  present  a summary  with  our  conclusions  on  the 
feasibility  of  developing  suitable  methods  to  estimate  future 
support  costs  for  fighter  aircraft  avionics  equipment  while 
that  equipment  is  still  under  develor  ..^nt  and  perhaps  even  in 
a "paper"  stage  of  development. 


A.  DEFINITION  OF  AVIONICS 

The  simplest  definition  of  avionics  is  airborne  electronics, 
but  this  is  too  general  for  our  research  which  examines  specific 
cost  estimating  approaches,  models,  and  data  systems  relating 
to  discrete  pieces  of  fighter  aircraft  equipment.  For  example, 
the  Air  Force  F-l6  Combat  Fighter  target  logistic  support  cost 
(TLSC)  model*  produces  cost  estimates  at  the  level  of  first 
line  unit  (FLU)^  equipments  such  as  the  radar  digital  signal 
processor  in  the  fire  control  system.  The  presence  of  hundreds 
of  FLUs  in  a modern  fighter  development  program  like  the  F-l6 
required  us  to  construct  a reasonably  precise  definitional 
structure  within  which  detailed  pieces  of  equipment  could  be 


*The  TLSC  model  is  discussed  in  Chapter  II. 

^A  FLU  is  the  first  level  of  assembly  below  the  2-dlgit  Work  Unit  Code 
level  that  is  carried  as  a line  item  of  supply  at  base  level.  It  is  the 
hlf^est  level  of  assembly  that  is  removed  and  replaced  as  a unit  in  order 
to  return  a piece  of  equipment  to  an  operational  status. 
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identified  as  avionics  or  not  avionics.  A further  complication 
is  the  fact  that  there  are  several  types  of  largely  electronic 
aircraft  equipments  that  are  not  considered  to  be  avionics 
(l.e.,  air  conditioning,  pressurization  equipment,  ice  control 
devices,  lighting  systems,  and  electrical  power  supply  units). 

Some  DoD  and  avionics  Industry  sources  focus  on  communica- 
tions, navigation,  weapons  control  and  delivery,  and  electronic 
countermeasures  equipments  as  avionics.  Other  sources  Include 
additional  categories  such  as  inflight  test  equipment  and  flight 
reference  systems.  Table  1 lists  the  twenty-three  equipment 
categories  that  provide  complete  coverage  of  all  aircraft  com- 
ponents that  are  usually  identified  as  avionics.  The  categories 
are  those  in  the  Work  Unit  Code  (WUC)  maintenance  action  equip- 
ment identification  structure  used  by  the  Services.' 

The  categories  describe  the  basic  functions  performed  by 
avionics  equipment  on  aircraft,  and  thus  provide  one  acceptable 
definition  of  avionics.  Alternative  definitions  can  be  tailored 
to  specific  requirements  and  can  be  developed  by  excluding  one 
or  more  equipment  categories  from  the  list.  Our  working  defini- 
tion of  avionics  in  this  study  is  the  comprehensive  alternative 
that  includes  all  WUCs  from  51  through  76  in  Table  1. 

Not  all  of  the  WUCs  in  Table  1 are  assigned  to  any  single 
aircraft  type.  This  is  shown  in  Table  1 for  four  fighter  air- 
craft, where  the  Navy's  P-l8  fighter  aircraft  has  thirteen  of 
the  twenty-three  codes,  the  Air  Force's  P-l6  ten,  the  F-I^IA 


'The  guiding  reference  for  WUCs  is  MILSTD  780.  IVo  digit  WUCs  such  as 
those  in  Table  1 Identify  basic  functions  that  are  performed  on  aircraft. 
The  WUC  system  is  the  coding  structure  for  identifying  equipment  to  mainte- 
nance actions  perfonned  at  the  organization  and  intermediate  levels. 
Additional  di^ts  up  to  seven  identify  more  and  more  detailed  pieces  of 
equipment  below  the  2-dlglt  functional  level.  For  exanple,  on  the  Navy's 
A-4  aircraft,  WC  72,  radar  navigation,  is  broken  down  to  more  than  200 
five  and  seven  digit  WCs,  such  as  WUC  72190  (terrain  avoidance  set 
AN/ARril53) , and  WUC  7239620  (pulse  decoder  on  receiver-transmitter 
F?T762/APN15i<  on  radar  beacon  set  AN/APN15^).  A more  conplete  discussion 
of  V/UCs  is  presented  in  Appendix  B. 
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AVIONICS  EQUIPMENT  CATEGORIES  ON  FOUR  FIGHTER 
AIRCRAFT 


Work 

Unit 

Code 


Equipment  Category 


Instruments 
Autopi lot 

Guidance  Systems  (Drone) 

Telemetry  System 

Inflight  Recording  System 

Flight  Reference 

Integrated  Guidance  and 
Flight  Control 

Inflight  Test  Equipment 

Target  Scoring  and 
Augmentati on 

HF  Communications  System 

VHF  Communications  Systems 

UHF  Communications  System 

Interphone  System 

IFF  Systems 

Emergency  Radio 

Integrated  COM-NAV-IFF 
Packages 

Miscel 1 eneous  Communications 
Radio  Navigation 
Radar  Navigation 
Bombing  Navigation 
Weapons  Control 
Weapons  Delivery 
Electronic  Countermeasures 


Ai rcraft 


F-18  F-16  F-14A  F-4N 
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sixteen,  and  the  P-i<N  nineteen.  Thus,  avionics  refers  to  a 
large  set  of  potential  equipment  categories  from  which  various 
sub-sets  of  equipment  categories  can  be  selected  to  make  up  the 
avionics  suites  for  different  aircraft. 

B.  THE  DPiE  TASK  ORDER 

This  study  was  undertaken  at  the  request  of  the  Office  of 
the  Secretary  of  Defense,  Director,  Planning  and  Evaluation 
(OSD/DP&E).^  Specific  study  requirements  include  the  following: 

(1)  Review  and  evaluate  current  methods  used  in  industry 
and  the  Navy  and  Air  Force  to  estimate  the  support 
costs  of  avionics  equipment  on  operational  aircraft 
systems; 

(2)  Review  and  evaluate  relevant  industry  and  defense 
studies  that  have  addressed  the  problems  of  esti- 
mating support  costs  of  avionics  equipment  through- 
out the  acquisition  process  prior  to  operational 
deployment ; 

(3)  Review  relevant  DoD  and  industry  data  systems  that 
can  provide  information  useful  for  acquisition 
cycle  avionics  support  cost  estimates; 

(4)  Determine  the  feasibility  of  developing  methods 
to  estimate  the  support  costs  of  avionics  equip- 
ment during  system  development  prior  to  opera- 
tional deployment.  Based  on  this  feasibility 
determination,  recommend  the  best  methods  to 
follow  in  dealing  with  avionics  support  cost 
estimates  at  DSARC  I and  II. 

The  material  to  satisfy  these  study  requirements  is  in  the 
succeeding  chapters  of  this  paper,  with  additional  relevant 
detailed  descriptions  of  key  institutional  structures,  data 
formats,  information  systems,  and  modeling  techniques  presented 
in  several  appendixes. 


'OSD/DP&E  became  the  Office  of  the  Assistant  Secretary  of  Defense  for  Program 
.'\nalysls  and  Evaluation  (OASD/PA&E)  effective  April  14,  1977.  The  original 
task  order  is  referred  to  in  this  paper  as  DP&E-llO,  and  the  orgined  sponsor- 
ing office  is  OSD/DP&E;  however,  the  office  title  change  requires  that  the 
conclusions  and  recoimendatlons  of  this  paper  be  directed  to  OASD/PA&E. 
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c. 


ASSUMPTIONS  AND  GUIDELINES 


Before  proceeding  with  our  study,  it  was  necessary  to 
establish  initial  assumptions  and  guidelines  to  define  the  con- 
text within  which  avionics  support  cost  estimating  techniques 
are  assessed  in  this  research.  These  assumptions  and  guidelines 
are : 


(1)  Avionics  support  cost  estimating  is  a process  that 
draws  upon  several  disciplines  including  statistics, 
accounting,  engineering,  economics,  mathematics,  and 
administration  and  management; 

(2)  Existing  data  and  management  information  systems  are 
to  be  used  as  elements  in  the  feasibility  determina- 
tion to  the  maximum  extent  possible; 

(3)  Several  studies  are  underway  that  address  avionics 
and  other  component  support  cost  estimating  pro- 
cesses. IDA  must  be  alert  to  the  results  of  these 
studies  as  they  become  available  as  potential  tools 
for  recommendatalon  to  OSD; 

( ) Recommended  avionics  support  cost  estimating  methods 
should  be  the  best  conceptually  available  regardless 
of  whether  they  are  currently  exercised  by  a specific 
modeling  technique  or  not; 

(5)  Although  not  necessarily  desirable,  cost  estimating 
methods  recommended  for  use  early  in  the  acquisition 
cycle  may  provide  less  detailed  equipment  level 
estimates  than  methods  recommended  for  later  in  the 
acquisition  cycle  when  equipment  system  definition 
is  greater; 

(6)  Warranty  cost  Impact  is  not  explicitly  considered, 
although  implicitly  it  is  because  analytical  tech- 
niques and  capabilities  available  in  the  Services 
and  contractors  are  the  same  whether  warrantied  or 
unwarrantled  equipments  are  under  discussion. 

Specific  applications  of  these  basic  costing  tech- 
niques and  capabilities  to  warranties  are  beyond 
the  scope  of  this  paper; 

(7)  This  paper  did  not  address  the  subject  of  imple- 
mentation of  the  recommended  alternative  models. 
Estimates  of  the  cost  of  Implementation  are  there- 
fore beyond  the  scope  of  this  paper; 

(8)  The  usefulness  of  specific  models  to  OSD  is  not 
assessed  in  the  sense  that  one  model  is  identified 
as  more  or  less  useful  than  another  model.  This 
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is  because  usefulness  is  defined  for  specific 
purposes,  and  a model  that  may  be  useful  in  one 
context  may  not  be  in  another.  However,  the 
circumstances  under  which  the  various  models  are 
most  appropriate  are  discussed  in  the  presentation 
and  evaluation  of  contractor  and  Service  methodogies. 

D.  APPROACH  AND  SCOPE  OF  RESEARCH 

In  undertaking  research  on  this  task  we  initially  reviewed 
available  literature  to  develop  information  on  major  conceptual 
approaches  to  the  problem.  We  did  not  attempt  to  examine  every 
study  or  document  that  relates  in  any  way  to  avionics  support 
cost  estimating.  Our  focus  was  in  conceptual  approaches  and 
our  research  was  thorough  in  this  area. 

Having  reviewed  the  literature  in  this  area,  we  then 
visited  key  Navy  and  Air  Force  activities  to  discuss  their 
experience  and  their  methods  for  dealing  with  the  problems 
encompassed  by  our  task  order.  We  secured  Service  views  on 
the  feasibility  of  preparing  reasonable  avionics  support  cost 
estimates  very  early  in  the  acquisition  cycle. 

Our  next  step  was  to  visit  major  fighter  aircraft  and 
avionics  contractors  to  determine  their  support  cost  estimating 
techniques.  We  also  consulted  with  representatives  of  other 
research  firms  to  discuss  their  relevant  research  and  gain 
insights  on  possible  conceptual  approaches. 

We  believe  that  our  field  research  was  sufficiently  thor- 
ough to  permit  us  to  define  the  conceptual  approaches  that 
represent  the  state-of-the-art  in  avionics  support  cost  esti- 
mating. As  would  be  expected,  there  is  a great  degree  of 
similarity  in  methods  used  in  private  Industry  and  in  the 
Services.  Differences  relate  primar^ily  to  the  level  of  detail 
considered  in  the  various  methods  rather  than  in  basic  con- 
ceptual approaches . 
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E.  THE  ROLE  OF  THE  DSARC  IN  THE  DOD  MAJOR  SYSTEM  ACQUISITION 

PROCESS^ 

The  Defense  Systems  Acquisition  Review  Council  is  an 
advisory  body  to  the  Secretary  of  Defense  (SECDEF)  on  major 
system  acquisitions.  The  DSARC  functions  as  part  of  a formal 
DoD  system  to  ensure  that  the  Secretary  of  Defense  is  Informed 
of  progress  on  new  major  system  acquisitions  and  has  the 
opportunity  to  decide  at  strategic  program  milestones  whether 
the  acquisitions  should  proceed  into  the  next  phase. ^ The 
system  also  permits  the  Secretary  of  Defense  to  establish  per- 
formance,  cost  and  schedule  targets  for  these  programs.®  At 
prescribed  milestones  in  the  major  system  acquisition  cycle, 
the  DSARC  reviews  Service  proposals  and  provides  its  recommenda- 
tions to  the  SECDEF.  Table  2 shows  the  DSARC  decision  mile- 
stones . 

The  Cost  Analysis  Improvement  Group  advises  the  DSARC  on 
matters  related  to  cost."*  Among  the  CAIG  responsibilities  are 
the  tasks  of  reviewing  and  evaluating  independent  and  program 
cost  estimates  prepared  by  the  Services  for  presentation  at 
each  DSARC  review.  The  CAIG  also  must  prepare  cost  estimates 
on  different  components  and  systems  for  the  DSARC  when  that 
council  is  considering  alternative  ways  to  satisfy  DoD  mission 
requirements . 


‘ihe  acquisition  pi?ocess  is  also  referred  to  as  the  DSARC  process,  althou^i 
the  Council  itself  is  only  one  element  of  the  process. 

*SECEEF  milestone  decisions  authorise  the  comnencement  of  various  steps  in 
the  acquisition  process,  but  they  do  not  authorize  the  conmitment  of  funds. 
To  seek  budget  approval  and  funding,  the  milestone  decisions  must  be  reflec- 
ted in  the  Planning,  Prograimlng  and  Budgeting  Systems  (PPBS)  documentation. 

^Reference  DoDD  5000.1,  Major  System  Acquisitions,  and  DoDD  5000.2,  Major 
System  Acquisition  Process,  both  dated  January  l8,  1977.  See  Table  2. 

‘‘Reference  DoDD  5000. OSD  Cost  Analysis  Improvement  Group,  June  13,  1973* 


Table  2.  CURRENT  SECRETARY  OF  DEFENSE  DSARC  MILESTONES  AND 
THEIR  RELATIONSHIPS  TO  WEAPON  SYSTEM  ACQUISITION 
CYCLE  PHASES 


Current  DSARC  Decision  Milestones  and  Acquisition  Phases  * 

Decision  Milestone 

Acquisition  Cycle  Phase  Initiated 

DSARC-0:  PROGRAM  INITIATION 
DECISION 

This  decision  Is  based  In 
part  on  the  SECDEF's  affirma- 
tion of  an  unfilled  mission 
need. 

CONCEPTUAL  PHASE 

This  phase  follows  and 

Is  authorized  by  an  affirma- 
tive DSARC-0  SECDEF  decision. 

DSARC-I:  DEMONSTRATION  AND 

VALIDATION  DECISION 

DEMONSTRATION  AND  VALIDATION 

PHASE 

This  decision  Is  based  In  part 
on  the  Conceptual  Phase  alterna- 
tives explored  as  solutions  to 
the  mission  need  affirmed  at 
DSARC-O. 

This  phase  follows  and  Is 
authorized  by  an  affirmative 

DSARC  I SECDEF  decision. 

DSARC-II:  FULL  SCALE  ENGINEER- 
ING DEVELOPMENT 

DECISION 

FULL  SCALE  DEVELOPMENT  PHASE 

This  decislon'is  based  In  part 
on  the  Demonstration  and  Vali- 
dation Phase  research  on  specific 
alternatives,  and  the  resultlno 
specific  service  source  selection. 

This  phase  follows  and  Is 
authorized  by  an  affirmative 

DSARC  II  SECDEF  decision. 

DSARC  III:  PRODUCTION  AND 

DEPLOYMENT  DECISION 

PRODUCTION  AND  DEPLOYMENT 

PHASE 

This  decision  Is  based  In  part 
on  the  test  results  generated  by 
the  flying  of  test  aircraft  dur- 
ing the  Full  Scale  Development 
Phase.  An  Initial  production 
decision,  called  DSARC  III. A,  may 
be  made  for  long  lead  production 
approval,  followed  later  by  a 

DSARC  III.B  decision  which  con- 
stitutes full  production  approval. 

This  phase  follows  and  Is 
authorized  by  an  affirmative 

DSARC  III  decision  (or  decisions). 
Actual  deployment  of  aircraft  Is 
authorized  by  the  DSARC  III 
decision  and  carried  out  during 
this  phase. 

1 . Milestone  0 - Program  Initiation 

The  Individual  Services  conduct  continuing  analyses  of 
their  assigned  mission  areas  to  Identify  existing  or  projected 
capability  deficiencies  and  opportunities  to  enhance  capabili- 
ties through  more  effective  and  less  costly  methods  and  systems. 
These  analyses  are  of  Interest  to  us  here  because  they  repre- 
sent the  first  step  In  a process  that  may  culminate  In  a major 
system  acquisition.  These  mission  area  analyses  may  be  con- 
ducted exclusively  "In  house,"  but  more  likely  will  be  supported 
by  contractors  who  conduct  parts  of  the  analyses  through  DoD- 
funded  conceptual  studies  or  through  their  own  efforts  to  keep 
abreast  of  the  latest  developments.  Contractors  may  also  take 
the  Initiative  and  develop  proposals  for  mission  area  capability 
Improvements  based  on  their  own  Independent  research  programs. 
SECDEF  guidance  concerning  mission  area  analyses  Is  provided 
through  Defense  Guidance  and  Program  Policy  Memoranda. 

When  a Service  Identifies  a new  major  mission  area  need, 
the  Service  prepares  a Mission  Element  Need  Statement  (MENS). 

The  MENS  describes  the  mission  and  attempts  to  Justify  to  the 
Secretary  of  Defense  the  Initiation  of  a new  major  system 
acquisition  to  satisfy  the  mission  need.  To  accomplish  this 
Justification,  the  MENS  briefly  (no  more  than  ten  pages)  states 
the  mission  need  In  terms  of  the  mission  task  to  be  performed, 
but  this  statement  does  not  Include  capabilities  and  character- 
istics of  hardware  or  software  systems.  The  exclusion  of 
capabilities  and  characteristics  precludes  cost  estimates  from 
routinely  appearing  In  the  MENS,  unless  the  mission  need 
Identified  Is  a cost  saving  opportunity.  If  the  mission  need 
were  a cost  saving  opportunity,  then  the  Identification  of  the 
magnitude  of  the  saving  would  be  necessary,  and  details  con- 
cerning hardware  capabilities  and  characteristics  related  to 
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the  potential  cost  saving  could  conceivably  be  entered  as  need 
Justification  material.* 

If  the  Secretary  of  Defense  approves  a program  to  satisfy 
the  mission  need  outlined  in  the  MENS,  he  will  specify  condi- 
tions for  the  Service  to  proceed  and  state  the  basis  for  action 
to  select  options  for  demonstration  and  validation.^  As  shown 
in  Table  2,  program  initiation  approval  constitutes  the  begin- 
ning of  the  conceptual  phase  of  system  acquisition.  The  Service 
concerned  then  publishes  a formal  Navy  Operational  Requirement 
(OR)  or  Air  Force  Required  Operational  Capability  (ROC)  document. 
During  this  conceptual  phase  the  Service  'emphasizes  competitive 
exploration  of  alternative  systems  to  satisfy  mission  needs 
described  in  the  OR  or  ROC  without  specifying  in  advance  the 
explicit  system  characteristics. 

2 . Milestone  I - Demonstration  and  Validation 

The  conceptual  phase  ends  when  the  Service  has  decided 
which  alternative  or  alternatives  offer  the  greatest  promise 
in  terms  of  satisfying  the  mission  need.  Efficiency  as  well 
as  effectiveness  must  be  considered  in  reaching  this  decision. 
Thus,  the  cost  and  schedule  variables  must  be  evaluated  with 
the  performance  variables  in  determining  the  most  appropriate 
alternati’’ js . 


*The  MENS  should  also:  1)  assess  the  projected  threat  throu^  the  time 
frame  the  capability  is  required;  2)  identify  existing  DoD  mission  capa- 
bilities in  the  need  area  and  identify  deficienceis ; 3)  state  the  known 
constraints  to  any  acceptable  solution  including  operational  and  logistical, 
NATA  requirements.  Investment  limits,  and  so  on;  *4)  assess  the  inpact  of 
not  acquiring  or  maintaining  the  capability;  5)  provide  a program  plan 
for  the  identification  and  exploration  of  conpetitlve  alternatives. 

^Before  the  MENS  is  sent  to  the  SECE£F  for  disposition,  the  DoD  conponent 
head  works  with  the  Defense  Acquisition  Executive  (identified  in  DoDD  5000.30, 
August  20,  1976,  as  the  Deputy  Secretary  of  Defense)  to  obtain  coiments  on 
the  MENS  from  the  OSD  staff  and  the  Office  of  the  Joint  Chiefs  of  Staff 
(OJCS).  When  sent  to  the  SECDEF,  the  MENS  is  acconpanied  by  a position 
paper  prepared  by  the  Defense  Acquisition  Executive  stating  his  assessment. 
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In  order  to  secure  a Secrjetary  of  Defense  decision  for 
further  work,  the  Service  prepares  a Decision  Coordinating 
Paper  (DCP).  This  paper  describes  the  alternative (s ) recommended 
for  demonstration  and  validation  to  meet  the  mission  needs  and 
discusses  the  projected  resource  investments  as  well  as  other 
characteristics  associated  with  each  alternative  that  was  con- 


sidered. The  full  range  of  Milestone  I DCP  program  issues 
which  the  SECDEF  must  consider  Include  whether  or  not 


(1)  the  mission  element  task  to  be  accomplished  is 
still  Judged  necessary  as  it  was  at  Milestone  0; 

(2)  the  threat  assessment  has  been  updated  and  is 
consistent  with  current  evaluations; 

(3)  the  alternative  system  design  concepts  adequately 
reflect  the  technology  base  and  provide  an  accept- 
able competitive  environment; 

(M)  foreign  developments  have  been  considered; 

(5)  the  alternatives  recommended  for  demonstration 
and  validation  meet  the  mission  element  needs; 

(6)  the  established  program  constraints  remain  valid; 

(7)  the  projected  resource  investment  for  the  selected 
alternatives  and  other  characteristics  related  to 
the  alternatives  are  consistent  with  the  stated 
constraints ; 

(8)  operational  and  logistical  considerations  are 
adequate ; 

(9)  use  of  available  subsystems  and  existing  military 
and  commercial  hardware  and  software  are  adequately 
considered; 

(10)  the  acquisition  strategy  is  complete,  effectively 
integrates  the  program  technical,  business  and 
management  elements,  and  supports  the  achievement 
of  program  goals  and  objectives; 

(11)  short-  and  long-term  business  planning  effectively 
supports  the  acquisition  strategy; 

(12)  producibility  and  areas  of  production  risks  have 
been  adequately  considered; 

(13)  Joint-Services,  Interoperability  and  multi- 
national considerations  are  adequately  treated 
in  the  planning; 
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(1^4)  NATO  standardization  and  interoperability 

requirements  have  been  adequately  considered; 

(15)  risk  and  uncertainty  areas  are  identified  and 
adequately  treated  in  the  planning; 

(16)  envirnomental  considerations  are  adequate; 

(17)  planning  and  schedules  for  preparation  of  the 
Test  and  Evaluation  Master  Plan  (TEMP)  are 
adequate . 

Currently,  the  SECDEP  does  not  consider  support  cost  esti- 
mates for  avionics  components  when  assessing  the  Milestone  I 
Issues  identified  above.  However,  the  DCP  goes  through  a 
staffing  process  of  reviews  and  iterations  before  it  is  pre- 
sented to  the  SECDEP  and,  during  this  period,  quantitative 
Judgments  concerning  costs  for  the  entire  aircraft  or  its 
major  components,  including  avionics,  may  be  introduced  into 
the  discussion  of  DCP  issues. 

The  initial  DCP  planning  meeting  at  the  OSD  level  may  occur 
several  months  prior  to  the  Milestone  I decision  date.  At  this 
meeting  the  DSARC  review  date  is  established,  the  program  alter- 
natives to  be  considered  are  identified,  and  specific  program 
issues  and  supporting  Information  are  discussed.  Support  cost 
issues  could  be  introduced  by  any  of  the  planning  meeting  mem- 
bers Including  the  Defense  Acquisition  Executive  representative' 
and  the  representatives  of  the  other  DSARC  members,*  Joint 
Chiefs  of  Staff,  Director  of  Defense  Research  and  Engineering, 
and  the  CAIG. 

Pollowing  the  meeting,  the  DoD  component  sponsoring  the 
acquisition  program  prepares  a "for  comment"  draft  DCP  to  be 


'DoDD  5000.30,  Defense  Acquisition  Executive,  August  20,  1976.  Ihe  Deputy 
Secretary  of  Defense  is  deslgiated  as  the  Defense  Acquisition  Executive. 

*DSARC  members  inclixle  at  a minimum  the  Defense  Acquisition  Executive, 
Director  of  Defense  Research  and  Ehglneerlng,  Assistant  Secretaries  for 
Program  Analysis  and  Evaluation,  Conptroller,  Intelligence,  Manpower, 
Reserve  Affairs  and  Logistics,  and  the  Director  of  Telecormunlcatlons  and 
Conmand  and  Control  Systems. 
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circulated  through  appropriate  OSD  staff  offices  for  refine- 
ment and  explanation  of  the  Issues.  Component  support  cost 
estimates  could  be  Introduced  as  Issues  or  elements  of  Issues 
In  this  staffing  process. 

The  for  comment  draft  DCP  with  accompanying  OSD  staff  com- 
ments Is  forwarded  to  the  sponsoring  component  head  from  the 
Defense  Acquisition  Executive.  The  component  then  prepares  a 
second  draft  DCP,  a "for  coordination"  draft,  distributed  to 
the  DSARC  members  fifteen  days  prior  to  the  scheduled  DSARC 
review.  The  DSARC  examines  the  Issues  and  prepares  a report 
sent  along  with  the  DCP  to  the  SECDEP  for  his  decision. 

If  the  SECDEF  signs  the  DCP  and  Issues  an  action  memorandum, 
this  constitutes  a Milestone  I (or  DSARC  I)  approval  of  the 
Service's  DCP  recommendation,  either  completely  or  with  modifi- 
cations.^ The  Service  proceeds  to  develop  hardware  and  perform 
demonstrations  of  this  hardware's  capability  to  satisfy  the 
mission  need,  and  through  these  demonstrations  validates  the 
ability  of  an  alternative  or  alternatives  to  meet  the  require- 
ment proposed  at  DS ARC'S  0 and  I. 

The  demonstration  and  validation  phase  concludes  when  the 
Service  conducts  a source  selection  and  chooses  the  system  to 
recommend  to  the  SECDEF  for  a Milestone  II  full  scale  engineer- 
ing development  decision. 


*As  a result  of  alternative  design  concepts  examined  during  the  conceptual 
stags,  the  DoD  conponent  head  may  conclude  that  the  DSARC  I DCP  should  con- 
tain one  or  a variety  of  hardware  proposals  for  the  demonstration  and 
validation  phase,  proposals  such  as:  1)  several  ciltemative  hardware  sys- 
tems; 2)  one  sin^e  hardware  system;  3)  demonstration  and  validation  of 
alternative  sub-systems  for  a single  hardware  system;  4)  by-passing  the 
demonstration  and  validation  phase  and  going  directly  into  fiill-scale 
engineering  development.  Ihus,  the  SECIEF  decision  at  Milestone  I may  be 
to  proceed  with  one  or  several  hairdware  or  sub-system  demonstrations 
before  Milestone  II. 
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3 . Milestone  II  - Full  Scale  Engineering  Development 

To  secure  Secretary  of  Defense  approval  at  Milestone  II, 
the  Service  updates  its  DCP  to  present  detailed  information  on 
the  system  it  has  selected  in  the  source  selection  for  full- 
scale  engineering  development.  Based  on  this  source  selection, 
the  DCP  will  now  address  the  total  program  through  completion 
including  research  and  development,  procurement,  and  operations. 

The  source  selection  that  is  incorporated  into  the  DCP 
update  for  consideration  in  the  Milestone  II  full-scale  develop- 
ment go-ahead  decision  is  the  result  of  a detailed  Service 
process.*  The  process  may  result  in  the  selection  of  a single 
source,  but  it  may  also  result  in  the  selection  of  more  than 
one  source  if  multiple  sources  are  desired,  as  would  be  the 
case  if  competitive  prototypes  are  desired  for  the  full-scale 
development  phase.  The  selection  is  an  integrated  decision 
taking  into  account  each  offeror's  technical  approach,  capa- 
bility, management,  design  to  cost,  historical  performance, 
life  cycle  cost,  and  other  factors  with  the  goal  of  selecting 
the  contractor  that  is  expected  to  do  the  best  overall  job  for 
the  government.  This  latter  requirement  means  that  no  single 
factor,  including  life  cycle  cost  and  support  costs  as  defined 
in  this  study, ^ should  dominate  the  source  selection  process. 
However,  component  support  costs  can  be  important  elements  in 
the  overall  comparative  evaluations  of  different  contractors, 
and  other  things  equal,  may  be  the  primary  discriminating 
difference  between  a source  selection  winner  and  the  losers. 


*See  DoDD  4105.62,  Selection  of  Contractual  Sources  for  Major  Defense  Sys- 
tems, January  6,  1976,  for  a detailed  description  of  DoD  policies  concerr>- 
Ing  the  conpetitive  selection  of  ccaitractual  sources  for  the  acquisition 
of  major  defense  systems  in  accordance  with  the  policies  contained  in  the 
acquisition  process  described  in  DoDD  5000.1  and  DoDD  5000.2.  DoIX)  4105.62 
was  amended  as  of  March  3>  1977  to  reflect  the  changes  to  DoDD  5000.1  and 
DoDD  5000.2,  both  dated  January  18,  1977. 

^Support  costs  are  organization,  Intemedlate,  and  depot  maintenance  costs, 
and  spares  and  repair  parts  support. 
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Avionics  component  support  costs  may  receive  substantial  atten- 
tion in  the  selection  of  a new  fighter  aircraft  contractual 
source  for  several  reasons  listed  below. 

(1)  The  avionics  suite  may  be  the  prime  difference 
between  an  existing  operational  aircraft  and  a 

new  F-X  aircraft  in  the  Milestone  0 and  I decisions. 

(2)  Given  the  avionics  suite  is  a high  priority 

item,  ar^onlcs  support  costs  are  substantial 
proportions  of  total  support  costs  on  existing 
systems  and  promise  to  be  on  new  systems.* 

(3)  Support  costs  have  grown  to  be  the  largest  single 
element  of  total  life  cycle  costs,  so  the ‘'avionics 
support  costs  on  an  F-X  proposal  submitted  for 
source  selection  are  of  vital  interest  to  DoD 
decision-makers  charged  with  approving  life  cycle 
cost-effective  defense  acquisitions. 

The  technical  requirements  of  a solicitation  from  a Service 
to  potential  contractors  may  be  stated  as  technical  goals,  as ' 
acceptable  values,  or  as  bands  of  acceptable  values  in  the 
cases  where  trade-offs  are  possible  among  performance  charac- 
teristics, schedules,  supportability , design  to  cost,  and  life 
cycle  cost  including  component  support  cost.  To  facilitate 
the  evaluation  of  these  trade-offs,  cost  estimates  that  illus- 
trate the  impact  of  these  trade-offs  upon  production  and  opera- 
ting and  support  costs  are  required.  The  capability  to  assess 
these  cost  estimates,  both  for  the  Service  and  for  OSD,  Is 
important  for  several  reasons. 

(1)  The  considerations  of  support  and  other  costs  pro- 
mote integrated  assessme.nts  of  the  capabilities 
of  contractors  to  do  the  Jobs  they  claim  they  can 
do.  Without  a capability  to  assess  and  verify  the 
appropriate  ranges  of  costs  associated  with  alterna- 
tive performances,  designs,  and  components,  the 
Services  and  OSD  cannot  produce  a balanced  appraisal 
of  which  contractor  can  do  the  best  overall  Job  for 
the  government.  To  reemphasize  an  earlier  point.  It 
is  essential  to  recognize  that  source  selection  Is 
not  dominated  by  a single  criterion.  Cost  interacts 


*See  Chapters  II  and  III  for  discussions  and  exanples  of  this  issue. 
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with  other  characteristics  to  produce  a picture 
of  the  contractor  that  can  do  the  best  job.  As 
aircraft  become  more  complex,  especially  in  their 
avionics  components,  the  necessity  to  assess  costs 
at  the  component  level  grows  more  pressing. 

(2)  Trade-offs  among  alternative  fighter  aircraft 
designs  may  hinge  on  differences  among  and 
between  components  and  their  life  cycle  costs 
including  support  costs.  To  assess  the  impact 
on  design,  performance,  and  costs  of  substituting 
one  radar  for  another  in  one  or  more  F-X  aircraft 
requires  a quantitative  functional  linkage  among 
these  characteristics  in  the  form  of  a mathematical 
computational  technique. 

When  Incorporating  the  source  selection  material  into  the 
revised  DCP,  the  Service  must  assure  the  SECDEF  that  performance, 
cost  and  schedule  estimates  have  been  thoroughly  reviewed  and 
that  they  are  well  defined  and  consistent  with  the  risks 
involved.  The  CAIG  plays  an  active  role  in  evaluating  the 
source  selection  and  in  formulating  recommendations  to  the 
Secretary  of  Defense  for  Milestone  II  decisions.  DoDD  5000.1 
prescribes  that  DCP  performance,  cost  and  schedule  estimates 
shall  not  be  formalized  or  considered  firm  prior  to  the  Mile- 
stone II  decision  since  systems  are  not  adequately  defined 
and  the  values  for  these  system  parameters  remain  uncertain 
during  the  early  phases  of  the  system  acquisition  process. 
However,  when  the  Service  selects  the  system  for  full  scale 
engineering  development,  "...firm  estimates  for  performance, 

! cost  and  schedule  shall  be  committed  to  documentation  in  the 

DCP."  Thus,  sufficient  information  should  be  available  at 
Milestone  II  to  permit  the  CAIG  to  validate  the  Service  program 
office  cost  estimates  that  have  been  developed  along  with  the 
contractor  in  the  source  selection  process.’ 


C 


’in  addition  to  the  DCP  cost  estimates  formulated  by  the  selected  contrac- 
tor and  the  Service  program  office,  the  Service  develops  an  Independent 
cost  estimate  to  assist  in  determining  the  most  probable  development, 
production,  and  support  costs.  These  estimates  are  prepared  as  part  of 
the  source  selection  process  and  are  made  available  to  OSD  as  pg^  of  the 
source  selection  documentation. 
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If  the  Secretary  of  Defense  approves  a full-scale  engineer- 
ing development  of  a major  system  at  Milestone  II,  he  establishes 
performance,  cost  and  schedule  values  including  estimates  of 
probable  variances  at  program  completion.  These  values  with 
their  probable  variances  are  identified  as  program  thresholds. 

The  entire  Milestone  II  set  of  program  issues  Include  whether 

(1)  the  mission  element  task  to  be  accomplished  is 
reaffirmed  and  the  threat  updated; 

(2)  the  system  selected  meets  the  mission  element  needs, 
is  cost-effective  and  is  acceptable  within  stated 
constraints ; 

(3)  NATO  standardization  and  interoperability  require- 
ments are  satisfied; 

(4)  the  demonstration  and  validation  results  support 
the  system  recommended; 

(5)  system  trade-offs  have  produced  the  most  effective 
balance  in  cost,  performance,  and  schedule  including 
operational  and  logistical  considerations,  and  life 
cycle  cost  considerations; 

(6)  uncertainties  and  risks  have  been  Identified  and 
are  acceptable;  planning  to  resolve  the  remaining 
uncertainties  and  risks  is  adequate,  and  realistic 
fall-back  actions  and  alternatives  have  been 
established ; 

(7)  the  acquisition  strategy  has  been  updated,  effec- 
tively supports  achievement  of  program  objectives, 
and  is  being  executed  in  the  conduct  of  program 
management ; 

(8)  short-  and  long-term  business  planning  supports 
the  strategy,  and  contract  types  are  consistent 
with  the  program  characteristics,  risks,  uncer- 
tainty and  strategy; 

(9)  design  to  cost  and  life  cycle  cost  requirements 
are  realistic  and  effective  in  achieving  cost 
obj  ectives ; 

(10)  cost,  performance  and  schedule  estimates  and 
related  thresholds  have  been  thoroughly  reviewed, 
and  are  well  defined  and  consistent  with  risks 
involved.  These  values  shall  be  established  as 
firm  estimates; 

(11)  action  to  submit  the  initial  Selected  Acquisition 
Report  (SAR)  is  complete; 


(12)  planning  for  selection  of  major  subsystems  Is 
clearly  stated,  provides  for  sustained  competition 
to  the  maximum  extent  feasible  and  accepts  the  use 
of  existing  military  and  commercial  hardware  and 
software  where  appropriate.  Foreign  developments 
have  been  considered; 

(13)  demonstration  and  validation  testing  and  evaluations 
have  been  completed  and  results  support  the  recom- 
mendations ; 

(14)  electronlc/lnfrared/optlcal  counter-measure  per- 
formance requirements  have  been  Identified; 

(15)  produclblllty  considerations  and  areas  of  production 
risks  have  been  reviewed  and  the  results  found 
acceptable ; 

(16)  requirements  have  been  established  for  long-lead 
procurement  Items,  Initial  limited  production  to 
support  operational  test  and  evaluation  needs,  and 
the  verification  of  production  engineering  and 
design  maturity  and  to  establish  the  production 
base ; 

(17)  the  Test  and  Evaluation  Master  Plan  (TEMP)  Identi- 
fies and  Integrates  the  testing  and  evaluation  to 
be  accomplished  prior  to  the  Milestone  III  program 
decision  points; 

(18)  the  program  management  structure  and  plan  are  sound 
and  adequately  supported. 


4 . Milestone  III  - Production  and  Deployment 

When  the  full-scale  engineering  development  phase  Is  com- 
pleted to  Include  Initial  operational  test  and  evaluation 
(lOT&E),  the  Service  prepares  Its  recommendations  to  the  Sec- 
retary of  Defense  for  the  Milestone  III  production  and  deploy- 
ment decision.  This  Is  accomplished  by  updating  the  DCP  to 
Include  all  of  the  relevant  Information  to  permit  this  decision 
to  be  made . 

At  this  time  schedule  and  cost  estimates  Including  operating 
and  support  costs  should  be  realistic  and  acceptable.  Design 
to  cost  and  life  cycle  cost  requirements  should  be  Identified. 

The  selected  system  Is  considered  affordable  and  remains  the 
best  alternative.  Needless  to  say,  all  cost  estimates  should 
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be  reasonably  firm  at  this  point  since  hardware  has  been  defined 
and  maintenance  and  supply  support  concepts  have  been  determined. 

If  the  SECDEF  approves  the  Service  proposal,  the  Service 
proceeds  with  contractual  actions  to  procure  the  new  major 
system  and  deploy  It  In  the  operating  forces.  Milestone  III 
Is  the  last  formal  milestone  In  the  major  system  acquisition 
cycle.  Subsequent  reviews  may  be  directed,  however,  using  the 
forms  and  procedures  of  the  DSARC  processes  Just  described. 

Some  systems  are  of  such  Importance  In  terms  of  cost  or  mission 
that  the  Secretary  of  Defense  may  desire  to  have  further  analysis 
and  review  that  can  be  best  provided  through  the  DSARC  system. 

F.  CONCEPTUAL  PROBLEMS  IN  AVIONICS  SUPPORT  COST  ESTIMATING 

In  Implementing  the  major  system  acquisition  review  process, 
the  DoD  Is  faced  with  Important  problems  relating  to  support 
costs.  Although  advanced  procurements  are  required  on  some 
hardware,  for  example,  spares,  the  weapon  system  support  phase 
of  an  aircraft's  life  cycle  begins  with  the  operational  deploy- 
ment of  units.  However,  the  decisions  made  during  the  DSARC 
program  review  process  prior  to  operational  deployment  largely 
determine  the  magnitude  of  these  support  costs.  Life  cycle 
cost  researchers  at  Grumman  Aerospace  Corporation  report  that, 
based  on  Grumman's  historical  experience,  75/?  to  855?  of  the 
life  cycle  costs  of  an  aircraft  weapon  system  are  determined 
by  decisions  made  early  In  the  conceptual  phase  near  DSARC  I.* 
Similar  experience  Is  reported  by  researchers  at  Boeing  Aero- 
space Company,  who  found  that  705?  of  the  life  cycle  costs  of 
Boeing  aircraft  programs  were  committed  by  the  decisions  made 
durlr^g  conceptual  planning.^  These  estimates  are  based  on 

'Bernard  I.  Rachowltz,  Grumnan  Aerospace  Corporation,  Designing  to  Cost 
(DTC/LCC),  paper  presented  to  the  36th  Annual  Conference  of  the  Society 
of  Allied  Wel^t  Engineers,  Inc.,  May  1977. 

*W.L.  Johnson,  R.E.  Reed,  Boeing  Aerospace  Company,  Maintainability /Eeli- 
ability  Impact  on  System  Support  Costs,  prepared  for  the  Air  Force  Fll^t 
Dynamics  Laboratory,  December  1973. 
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fifteen  year  life  cycles  from  development  through  procurement, 
operation,  and  retirement  from  the  active  fleet.  Our  discus- 
sions with  other  contractors  revealed  similar  experience.  This 

dominant^ life  cycle  cost  impact  of  conceptual  stage  decisions 

\ 

is  one  reason  why  the  Secretary  of  Defense  has  refined  the 
weapon  system  acquisition  process  to  include  life  cycle  costs 
as  explicit  program  decision  parameters  through  the  process. 

Because  support  costs  are  the  largest  single  category  of 
life  cycle  costs,  emphasis  on  one  is  consistent  with  emphasis 
on  the  other.  Current  life  cycle  cost  estimates  for  the  Navy 
F-l8  and  A-l8  development  programs  attribute  of  life  cycle 
costs  to  operating  and  support  costs,  with  another  12%  attrib- 
uted to  initial  support  costs,  for  a total  of  565?.’  A comparable 
percentage  is  estimated  for  the  Air  Force  F-l6  program,  where 
recurring  and  non-recurring  O&S  costs  account  for  585?  of  life 
cycle  costs.  ^ 

Estimating  future  support  costs  for  avionics  is  particu- 
larly difficult.  Lt . Gen.  Alton  D.  Slay,  USAF  Deputy  Chief 
of  Staff  for  Research  and  Development,  has  stated  that  "...in 
some  modern  aircraft,  the  avionics  equipment  costs  upward  of 
thirty  percent  of  the  total  aircraft  flyaway  costs.  Avionic 
support  costs  are  equally  high,  approaching  seventy-five  percent 
of  total  support  costs  for  some  older  aircraft  with,  in  fact, 
avionics  being  the  limiting  factor  on  overall  airplane  relia- 
biliy."’  Currently,  the  Air  Force  is  spending  155?  of  its 
total  R&D  budget  on  avionics.  Technological  developments  are 
proceeding  so  rapidly  that  the  Air  Force  is  "turning  over"  its 
avionics  inventory  every  fifteen  to  twenty  years.  These  tech- 
nological developments  have  large  impacts  on  system  support 

’The  F-l8  and  A-l8  life  cycle  costs  are  based  on  20  years,  1980-2000, 

McDonnell  Aircraft  Company  brrieflng,  August  1977. 

*The  F-16  life  cycle  costs  are  based  on  15  years,  1977-1992,  General 
Dynamics  Fbrt  Worth  briefing,  August  1977. 

^Air  Force  Magazine,  July  1977,  p.  30. 
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costs  as  dramatic  changes  occur  in  avionics  equipment  charac- 
teristics and  in  maintenance  concepts. 

In  summary,  the  avionics  technology  is  changing  rapidly 
making  it  extremely  difficult  for  DoD  to  define  with  any  pre- 
cision early  in  system  acquisition  (DSARC  0 or  I)  the  charac- 
teristics of  avionics  equipment  that  eventually  will  be  installed 
on  a fighter  aircraft  or  the  maintenance  concepts  to  be  applied 
to  that  equipment.  On  the  other  hand,  these  early  decisions 
are  extremely  Important  because  they  will  have  a major  impact 
on  the  final  support  costs  to  be  incurred  by  the  system  when  it 
becomes  operational. 

Several  alternatives  are  available  to  the  Secretary  of 
Defense  when  addressing  this  problem.  First,  he  may  conclude 
that  it  is  virtually  impossible  to  estimate  avionics  support 
costs  as  early  as  DSARC  0 or  I and  either  disregard  support 
costs  at  these  milestones  or  limit  the  analysis  to  broad  total 
system  estimates.  This  alternative  has  the  disadvantage  of 
offering  no  guidance  to  the  system  developers  regarding  the 
importance  of  support  costs  on  avionics  compared  to  performance, 
schedule  or  other  cost  variables.  Another  disadvantage  is  that 
alternative  avionics  suites  cannot  be  assessed  against  each 
other  for  a specific  aircraft  or  for  different  F-X  aircraft 
proposals.  SECDEF  can  emphasize  in  general  terms  the  importance 
of  cost  minimization  but  this  does  not  help  the  designer  who 
must  consider  alternative  ways  for  fulfilling  the  avionics 
functions  on  the  aircraft. 

Another  alternative  is  to  acquire  data  on  the  historical 
Service  cost  experience  in  supporting  avionics  equipment,  then 
attempt  to  determine  how  these  costs  should  change  when  the  new 
aircraft  enters  the  Inventory.  This  alternative  requires  a 
reasonably  accurate  data  base.  It  also  requires  a "crystal 
ball"  analysis  of  current  versus  future  technological  state- 
of-the-art  equipments,  maintenance  concepts,  and  the  impact  on 
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historical  support  costs  of  any  forecast  changes  in  equipment 
or  maintenance  concepts. 

Since  the  SECDEP  must  consider  possible  future  system 
support  costs  even  when  system  characteristics  are  ill-defined, 
in  subsequent  chapters  we  will  discuss  the  ways  in  which  the 
Services  and  contractors  treat  the  problem  of  estimating  avionics 
support  costs  in  the  early_  stages  of  major  system  acquisition. 

It  is  useful  to  precede  these  Service  and  contractor  discussions 
by  a consideration  of  the  most  prominent  conceptual  problems 
associated  with  early  component  support  costs  estimates,  partic- 
ularly as  they  apply  to  avionics  components. 

1 . System  Characteristics  Versus  Maintenance  Concepts 

There  is  an  interaction  between  system  characteristics  and 
maintenance  concepts  that  tends  to  compound  the  problem  of  the 
cost  analyst.  First,  it  must  be  recognized  that  the  character- 
istics of  the  avionics  equipment  have  a major  impact  on  the 
concepts  that  must  be  adopted  by  the  Services  to  maintain  that 
equipment.  For  example,  relatively  simple  equipment  should 
be  repairable  in  the  field  whereas  complex  equipment  can  only 
be  satisfactorily  repaired  at  a depot  or  even  in  the  manufac- 
turer's facility.  On  the  other  hand,  technological  developments 
may  simplify  certain  repair  functions  permitting  more  field 
maintenance  of  equipments  that  in  the  aggregate  may  be  very 
complex.  Therefore,  it  may  be  necessary  to  define  fairly 
specifically  the  characteristics  of  some  avionics  equipment 
before  the  Service  can  resolve  questions  relating  to  maintenance 
concepts.  These  concepts  can  have  a heavy  impact  on  maintenance 
manpower  and  spares  requirements. 

On  the  other  hand,  maintenance  concepts  may  dictate  some 
of  the  requirements  in  avionics  equipment  components.  War  plans 
may  require  certain  maintenance  capabilities  in  field  units  and 
these,  in  turn,  may  have  a major  impact  on  how  the  avionics 
equipment  must  be  designed. 


Service  statements  of  operational  requirements  (ORs  and 
ROCs)  may  resolve  the  Issue  of  system  characteristics  versus 
maintenance  concepts.  However,  In  the  two  dynamic  areas  of 
national  defense  needs  and  avionics  technology  changes,  devel- 
opments may  occur  through  the  acqulsltllon  cycle  that  require 
a reexamination  of  this  Interface.  For  example,  miniaturiza- 
tion of  electronics  components  offers  significant  opportunities 
for  changes  In  concepts  to  perform  the  maintenance  function 
more  efficiently  and  effectively. 

For  this  reason,  support  cost  estimates  made  very  early  In 
the  acquisition  cycle,  particularly  If  based  on  parametric  cost 
estimating  relationships  using  historical  cost  data,  could 
prove  to  be  quite  Inaccurate.^ 

2 . Use  of  Historical  Data  as  a Basis  for  Cost  Estimating 

Avionics  support  cost  estimating  methods  are  of  several 
types.  The  first  method  referred  to  Is  an  "engineering”  or 
"bottoms-up"  approach  that  examines  the  Individual  components 
In  the  avionics  suite  of  an  aircraft  and  attempts  to  calculate 
future  support  costs  by  estimating  such  factors  as  forecast 
reliability  and  maintainability  of  the  individual  items.  Num- 
bers of  required  spare  parts  and  maintenance  manhours  can  be 
computed.  To  these  totals  the  analyst  applies  price  list  data 
on  parts  and  labor  rates  per  hour.  By  aggregating  cost  data  it 
is  possible  to  derive  a support  cost  estimate  for  the  full  life 
cycle  of  an  aircraft. ^ 

Another  major  support  cost  estimating  method  Is  based  on 
the  use  of  a data  base  containing  historical  Information  on 
support  costs  of  existing  avionics  equipment.  The  analyst 


^'Hie  conceptual  inpllcatlons  of  using  parametric  repression  techniques  In  a 
rapidly  changing  environment  are  addressed  in  Chapter  IV. 

*See  the  discussion  of  the  Westln^ouse  EAR  program  In  Chapter  III. 
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attempts  to  find  an  aircraft  with  avionics  equipment  comparable 
to  the  equipment  that  may  be  installed  on  the  new  aircraft,  and 
this  equipment  Is  used  as  a baseline  system  of  reference.  By 
analogy  and  scaling,  usually  based  on  Judgment  and  using  his- 
torical data  on  the  baseline  system,  the  analyst  will  attempt 
to  put  together  a cost  estimate  for  the  support  of  the  avionics 
equipment  on  the  new  aircraft . * 

An  approach  that  uses  historical  data  in  statistical  tech- 
niques that  permit  quantatitive  measures  of  uncertainty  is  the 
development  of  parametric  cost  estimating  equations.  For 
example,  through  regression  analysis  using  historical  data  the 
analyst  may  find  that  avionics  equipment  weight  seems  to  be  a 
suitable  independent  variable  in  an  equation  to  explain  support 
costs  for  avionics  equipment.  Thus,  given  the  probable  weights 
of  the  avionics  equipment  in  the  new  aircraft,  the  analyst  simply 
uses  the  equation  to  compute  the  future  support  costs  for  that 
new  equipment.^ 

There  are  at  least  three  major  problems  associated  with 
the  use  of  historical  data  bases  in  developing  estimates  of 
future  support  costs  for  avionics  equipment,  and  these  are 
discussed  below. 

a . Data  accuracy 

It  is  readily  agreed  by  experienced  analysts  that  serious 
inaccuracies  exist  in  Service  data  related  to  field  maintenance 
actions  and  the  costs  of  those  actions.  Differences  in  termi- 
nology between  field  and  depot  maintenance  accounting  systems 
and  differences  in  equipment  nomenclature  introduce  other 
potential  accuracy,  consistency,  and  comparability  problems  when 
data  from  the  two  types  of  systems  are  combined. 


'See  the  discussion  of  analogy  estimating  in  Chapter  III. 
*See  regression  discussions  in  Chapters  II  and  III. 
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A major  problem  in  accounting  for  spare  parts  support  is 
to  identify  the  equipment  on  which  a particular  spare  part 
shipped  from  the  depot  will  be  Installed.  This  is  especially 
important  when  attempting  to  use  analogy  for  cost  estimating 
since  the  baseline  system  costs  should  be  complete  and  rela- 
tively accurate  if  they  are  to  be  used  as  a basis  for  projec- 
tion of  costs  on  the  new  system. 

These  are  just  a few  of  the  problems  relating  to  accuracy 
of  historical  data.  These  problems  may  be  overcome  by  scien- 
tific sampling  of  data  on  field  experience,  by  research  in  the 
field  to  adjust  reported  data  that  permits  an  analyst  to,  in 
effect,  "build"  a data  base,  and  through  other  special  actions. 
The  difficulty  is  that  these  efforts  can  be  extremely  expensive 
and  time-consuming  and  still  may  not  yield  accurate  data.  It 
must  be  recognized,  however,  that  new  DoD  data  management  systems 
such  as  those  developed  under  the  OSD-directed  Visibility  and 
Management  of  Support  Cost  program  (VAMOSC)  offer  hope  for 
overcoming  accuracy  and  consistency  problems,  thereby  enhancing 
the  opportunities  to  compare  costs  between  and  among  systems.* 

b . Changing  Institutions 

Any  analysis  using  historical  data  must  assume  a certain 
amount  of  constancy  in  the  institutions  that  have  an  impact 
on  that  data.  For  example,  data  on  support  costs  of  weapon 
systems  during  the  Vietnam  War  would  probably  be  of  little 
value  as  an  Indicator  of  support  costs  in  today's  peacetime 
environment . 


Reorganizations  of  operational  forces  or  logistic  support 
activities  can  affect  significantly  total  support  costs  for 


*See  Department  of  the  Navy,  Air  Systems  Cormand,  NALCOMIS-OSS/(VAMOSC~AIR) 
Maintenance  Subsystem  Report , December  31,  1976  and  NALCOMIS-OAS  (VAMOSC- 
AIR)  Total  Support  System  Report,  December  31,  1976.  Also  see  Headquarters, 
U.S.  Air  Force,  Operatina  and  Support  Cost  Estimatinp  Reference  (OSCER) 
Report,  FY  76,  as  of  July  26,  1977- 
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avionics  equipment.  Even  a shift  in  emphasis  from  organic  to 
contract  support  or  vice  versa  and  the  use  of  warranti,es  on 
purchased  equipment  can  invalidate  cost  estimates  based  on 
historical  relationships  because  these  historical  relationships 
no  longer  apply. 

Have  skill  levels  changed  under  the  All  Volunteer  Force 
concept?  Have  new  system  acquisition  policies  with  require- 
ments for  more  testing  prior  to  procurement  improved  the  quality 
and  lowered  support  costs  for  nev;  equipment?  These  are  examples 
of  institutional  factors  that  could  have  important  effects  on 
maintenance  support  costs,  thus  invalidating  a large  body  of 
historical  Information. 

c . Technology 

We  have  already  discussed  the  way  in  which  changing  tech- 
nology can  cause  historical  cost  data  to  be  of  limited  value 
for  predicting  future  support  costs  of  new  technology  equip- 
ments. It  follows  that  if  technology  is  relatively  stable  for 
a given  component  of  an  aircraft  or  an  avionics  suite,  historical 
data  may  be  used  to  estimate  future  costs.  Also,  historical 
data  may  be  adjusted  to  accomodate  certain  one-time  technological 
changes.  However,  it  is  exceedingly  difficult  to  develop  proper 
adjustment  factors  for  these  data  if  technological  changes  are 
continuous  and  pervasive  throughout  the  system.  Experience 
dictates  that  avionics  equipment  undergoes  this  latter  kind  of 
technological  change.  When  dealing  with  continuous  change,  the 
best  approach  is  to  develop  some  kind  of  technological  change 
index  number  that  can  be  applied  to  the  final  results  of  the 
calculations  based  on  historical  data.  However,  even  to  do 
this  it  is  necessary  that  technology  be  changing  at  some  constant 
rate  over  time.  As  a last  resort,  an  analyst  may  adjust  histor- 
ically based  support  cost  estimates  by  an  equipment-by-equlpment 
analysis  of  recent  technological  changes  and,  through  Judgment, 
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extrapolate  the  effects  of  these  changes  on  support  costs,  but 
this  is  an  unsystematic  and  highly  subjective  procedure  that 
leads  to  uncertain  results. 

3 . The  "Fixed  Cost"  Problem 

Most  support  cost  estimating  methods  make  no  provision  for 
the  difference  between  fixed  and  variable  costs;  in  fact, 
conceptually,  they  assume  that  all  costs  are  variable.  These 
methods  generally  attempt  to  develop  a support  cost  per  air- 
craft, per  squadron,  or  per  flying  hour  and  the  costs,  there- 
fore, vary  in  a strict  linear  fashion  with  the  changes  in  the 
program  variables. 

This  concept  may  be  suitable  if  only  gross  cost  estimates 
are  desired  and  the  decision-maker  is  willing  to  accept  a wide 
margin  of  error,  or  if  the  changes  in  the  program  variables 
are  relatively  small.  They  may  also  be  acceptable  in  trade-off 
analyses  when  the  major  difference  between  systems  relate  only 
to  acquisition  costs  with  their  attendant  impact  on  costs  of 
spares . 

In  terms  of  the  purpose  of  this  study,  the  "fixed  cost" 
problem  may  be  most  serious  as  related  to  field  maintenance. 

It  has  been  estimated  that  a maintenance  technician  works  on 
maintenance  tasks  only  about  of  his  time.*  Presumably  he 

has  other  responsibilities  that  consume  the  remainder  of  his 
time  or  he  possesses  a skill  that  must  be  available  at  the 
field  unit  even  if  that  skill  is  used  only  of  the  time. 

The  "fixed  cost"  problem  is  most  serious  when  we  are 
attempting  to  apply  cost  criteria  in  the  selection  of  an 
alternative.  We  may  find  that  savings  indicated  by  a linear- 
based  cost  estimating  method  may  be  significantly  overstated. 


'Based  on  Navy  research  and  used  by  the  Navy  Air  Development  Center  in 
estimating  labor  costs  in  the  field. 


Fixed  costs  in  the  real  world  envirnoment  of  employment  of  the 
aircraft  system  may  reduce  significantly  or  eliminate  the  pre- 
sumed advantage  of  one  system  over  another. 


The  Marginal  Cost  Concept 


To  this  point  we  have  been  discussing  cost  methodologies 
that  attempt  to  develop  total  life  cycle  support  costs  for 
fighter  aircraft  avionics  systems.  Application  of  marginal 
cost  concepts  must  be  identified  as  a potential  solution  to 
some  costing  problems.  Regardless  of  the  exact  nature  of  a 
given  avionics  system,  it  can  be  assumed  that  all  such  systems 
will  require  spare  and  repair  parts  and  field  and  depot  mainte- 
nance support.  Thus,  it  may  be  possible  to  consider  the  level 
of  such  support  activities  at- a point  in  time  as  a "steady 
state"  level  of  support.  Then  the  analyst  could  attempt  to 
develop  support  cost  estimates  on  a marginal  basis  showing  how 
the  "steady  state"  costs  would  rise  or  decline  with  the  intro- 
duction of  the  new  aircraft. 

This  marginal  cost  approach,  which  is  applied  in  many 
industrial  environments,  may  be  applicable  in  support  cost 
estimating  for  avionics  equipment. 

5 . Trade-Off  Estimates  Versus  Point  Estimates 

Support  cost  estimates  to  validate  specific  point  values 
of  Service-contractor  DCP  estimates  are  different  in  character 
from  estimates  used  to  perform  trade-offs  between  and  among 
alternative  component  designs,  configurations,  and  reliabilill- 
tles.  Ideally,  an  estimating  technique  should  be  able  to  pro- 
duce cost  estimates  useful  and  accurate  for  both  point  and 
trade-off  estimation,  but  practically  there  are  major  difficul- 
ties in  combining  both  characteristics  within  a single  technique, 

Point  validation  estimates  must  be  accurate  in  their 
absolute  values  because  they  are  essentially  estimating  the 


support  costs  as  a fixed  value  at  a distant  point  in  time  and 
these  costs  are  the  basis  for  affordability  evaluations.  In 
contrast,  trade-off  estimates  must  be  consistent  across  dif- 
ferent component  designs  and  physical  characteristics.  That 
is,  they  must  Isolate  the  characteristics  that  distinguish  one 
component  design  from  another,  but  these  characteristics  need 
not  be  the  same  ones  that  contribute  to  fifteen  year  absolute 
life  cycle  cost  values. 

The  implication  of  this  difference  between  point  and 
trade-off  estimates  is  that  it  is  possible  that  one  methodolo- 
gical cost  estimating  approach  would  be  appropriate  to  point 
estimates  and  another  appropriate  to  trade-off  estimates. 

6 . Coping  With  the  Conceptual  Problems 

Throughout  this  paper  we  will  be  discussing  support  cost 
estimating  methods  and  conceptual  problems  associated  with 
those  methods.  Earlier  we  stated  that  DoDD  5000. 1 prescribes 
that  "...cost  estimates  shall  not  be  finalized  or  considered 
firm  prior  to  the  Milestone  II  decision."  This  statement 
should  not  be  construed  to  mean  that  no  cost  estimates  need  to 
be  prepared  prior  to  DSARC  II. 

Our  conclusion  after  research  on  this  study  is  that,  in 
view  of  the  importance  of  avionics  support  costs,  estimates  of 
these  costs  must  be  prepared  prior  to  DSARC  II.  However,  the 
OSD  decision-maker  must  be  willing  to  accept  significant  degrees 
of  uncertainty  in  these  estimates.  Also,  it  may  be  desirable 
to  use  different  methodologies  at  different  decision  points, 
so  accounting-oriented  efforts  to  have  an  audit  trail  from  one 
estimate  to  the  next  may  be  inappropriate.  More  emphasis  should 
be  placed  on  reviewing  the  rationale  and  inputs  for  estimating 
methods  than  on  precise  comparisons  of  one  estimate  to  the  next. 
We  believe,  however,  that  from  DSARC  II  on  through  the  acquisi- 
tion cycle,  audit-trail  type  tracking  is  appropriate.  These 
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comments  on  methodologies  and  the  way  to  treat  cost  estimates 
apply  equally  to  Service-provided  estimates  and  independent 
estimates  prepared  at  the  OSD  level. 

Our  research  has  persuaded  us  that  based  on  the  above 
statements  regarding  the  use  of  estimates  it  is  possible  and, 
in  fact,  essential  to  produce  avionics  support  cost  estimates 
in  the  early  stages  of  fighter  aircraft  acquisition  programs. 
Given  the  acceptance  of  uncertainty  in  estimates,  ways  can  be 
devised  to  cope  with  the  conceptual  problems  in  developing 
these  estimates. 

It  cannot  be  emphasized  too  strongly  that  OSD  cannot  per- 
mit estimates  prepared  prior  to  DSARC  II  to  become  firm  "bogeys" 
or  targets  for  funding  actions.  They  must  be  accepted  as  order 
of  magnitude  estimates  so  decisions  can  be  made  on  the  rough 
affordability  of  a new  system.  Attempts  to  apply  audit-trail 
approaches  to  these  estimates  will  be  counter-productive. 
Analysts  then  would  be  forced  to  include  factors  for  uncertain 
contingencies  in  their  estimates  or  perhaps  their  estimates 
would  be  prepared  and  presented  in  a gamesmanship  atmosphere 
rendering  them  of  limited  value. 

In  the  final  chapter  of  this  paper  we  will  present  our 
recommendations  on  approaches  to  deal  with  the  avionics  support 
cost  estimating  problems,  our  conclusions  regarding  the  con- 
ceptual problems,  and  our  Judgments  of  how  cost  estimates  must 
be  employed  within  the  DoD  major  system  acquisition  review  and 
decision-making  environment. 

G.  PRIOR  RESEARCH  ON  AVIONICS  SUPPORT  COST  ESTIMATING 

In  our  research  we  reviewed  150  reports  and  similar  mate- 
rials relating  to  the  subject  area  of  this  study.  We  found 
48  of  these  documents  to  be  of  sufficient  relevance  that  we 
prepared  descriptive  summaries  of  them  and  have  included  these 
summaries  in  Appendix  A of  this  paper. 
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Documents  covering  prior  research  may  be  grouped  Into  the 
following  categoires. 

1 . Avionics  - Institutional 

These  publications  establish  a framework  for  understanding 
the  multiple  characteristics  and  uses  of  military  electronics 
equipment.  Publications  in  this  group  include  coverage  of 
avionics  and  are  useful  to  give  an  understanding  of  problems 
associated  with  avionics  support  cost  estimating.  The  most 
comprehensive  study  is  Eleotvonias-X : A Study  of  Military 
Eleatronias  With  Particular  Reference  to  Cost  and  Reliability ^ 
Institute  for  Defense  Analyses,  January  197^. 

2.  Avionics  - Acquisition  Policies  and  Cost  Estimating 

Meth'ods 

This  group  deals  generally  with  the  acquisition  as  opposed 
to  operating  phase  of  the  avionics  equipment  life  cycle.  These 
research  documents  provide  insights  on  hardware  cost  estimating 
methods  that  may  be  useful  in  considering  the  spare  parts  seg- 
ment of  the  avionics  support  cost  estimating  process.  An 
example  of  this  research,  which  also  provides  considerable  con- 
ceptual evaluations  of  the  basic  theoretical  problems,  is 
Estimating  Avionics  Equipment  Costs  for  Military  Aircraft, 

J.  Watson  Noah  Associates,  December  197^. 

3 . Avionics  - Support  Cost  Estimating  Methods 

A few  publications  are  available  in  this  subject  area. 
Usually  this  subject  is  treated  in  studies  primarily  directed 
toward  acquisitions  or  life  cycle  cost  estimating.  None  of 
this  material  was  found  to  offer  suitable,  directly  applicable, 
methods  for  estimating  avionics  support  costs,  particularly  in 
early  stages  of  hardware  development.  Work  accomplished  at  the 
General  Research  Corporation  has  been  prominent  in  this  area, 
including  Cost  Analysis  of  Avionics  Equipment,  February  197^. 
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4. 


Cost/Technology  Indices 

A limited  amount  of  Information  is  available  on  prior 
research  relating  to  cost/technology  indices.  The  few  studies 
available  consider  ways  to  modify  acquisition  cost  estimates 
by  factoring  in  the  effects  of  changing  technology  on  cost. 

We  found  limited  prior  research  attempting  to  develop  indices 
that  might  be  used  to  adjust  avionics  support  cost  estimates 
to  reflect  changes  in  technology  over  time.  A useful  summary 
of  previous  work  and  a suggested  alternative  approach  is  pro- 
vided in  Development  of  Avionias  Cost  Technology  Indices,  Naval 
Air  Development  Center,  April  1972. 

5 . Reducing  or  Controlling  Avionics  Costs 

These  studies  address  specific  ways  in  which  avionics 
acquisition  and  support  costs  may  be  reduced  or  controlled. 

In  some  Instances  they  offer  insights  on  the  state-of-the-art 
in  avionics  cost  estimating,  for  example  the  study  DoD  Actions 
to  Control  Avionics  Life-Cycle  Costs,  RAND  Corporation,  May 
1973*  However,  most  of  these  studies  are  oriented  more  toward 
management  techniques  than  cost  estimating  methods. 

6 . Statistical  Techniques  Used  in  Cost  Estimating 

A considerable  body  of  literature  exists  on  statistical 
techniques  as  applied  to  cost  estimating.  Some  of  this  infor- 
mation is  useful  in  considering  what  methods  might  be  used  for 
avionics  support  cost  estimating.  A good  discussion  and  review 
of  the  estimating  properties  of  various  regression  equation 
forms  is  presented  in  Aircraft  Operating  and  Support  Cost 
Impacts  of  Support  Concepts  and  Design  Characteristics  - 
Improved  Regression  Through  Biased  Estimators , TRACOR,  March 
1976. 


33 


7. 


Operations  and  Support  Cost  Estimating  Methods 

These  papers  cover  the  entire  field  of  O&S  cost  estimating. 
Some  of  them  treat  the  general  topics  of  O&S  costs  and  others 
consider  Impacts  of  support  concepts,  reliability,  maintain- 
ability and  other  factors  that  affect  O&S  costs.  These  publica- 
tions provide  useful  Information  on  support  costs  but  do  not 
address  specifically  the  subject  of  this  study.  A typical 
equipment-level  study  of  avionics  is  the  Research  Study  of 
Radar  Reliability  and  Its  Impact  on  Life  Cycle  Cost  for  the 
APQ-113,  -114,  -120,  and  -144  Radars,  General  Electric,  April 
1973. 

8 . Design  to  Cost 

A few  studies  and  publications  are  available  that  address 
exclusively  the  topic  of  design  to  cost.  These  documents  are 
of  little  use  in  this  study  except  as  general  background  on 
the  DoD  acquisition  process.  An  example  is  provided  by  the 
Joint  Logistics  Commanders  Guide  on  Design  to  Cost,  Air  Force 
Systems  Command,  Chief  of  Naval  Material,  and  Army  Materiel 
Command,  January  1976. 

9 . Life  Cycle  Costing 

A very  considerable  body  of  literature  exists  on  life  cycle 
costing.  Included  in  this  literature  are  descriptions  of  models, 
data  sources,  special  studies,  and  guides  for  performing  life 
cycle  costing.  None  of  these  publications  was  found  to  provide 
specific  tools  or  conceptual  frameworks  for  dealing  with  the 
problem  of  avionics  support  cost  estimating  in  the  early  stages 
of  system  acquisition.  A primary  resource  document  for  an 
overview  of  life  cycle  costing  methodology  is  Life  Cycle  Cost 
Analysis  Guide,  Joint  Commander’s  Working  Group  on  Life  Cycle 
Cost,  November  1975. 
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Chapter  II 


SERVICE  SUPPORT  COST  ESTIMATING  METHODOLOGIES 
FOR  FIGHTER  AIRCRAFT  AVIONICS 

A.  INTRODUCTION 

Current  Air  Force  and  Navy  fighter  aircraft  avionics 
support  cost  estimating  methodologies  are  similar  in  form  but 
differ  in  the  emphasis  and  applications  they  receive  as  employed 
by  the  two  Services.  Prior  to  source  selection  and  DSARC  II, 
both  Services  exercise  total  weapon  system-level  methodologies 
that  do  not  address  avionics  support  costs  at  the  individual 
component  equipment  level.  In  the  Air  Force,  an  historical 
cost  factor  model  estimates  support  costs  for  the  airframe, 
propulsion  system,  and  the  total  avionics  suite  on  a proposed 
aircraft;*  while  in  the  Navy,  a parametric  regression  model 
produces  total  aircraft  estimates  for  several  categories 
including  depot  maintenance  component  rework,  which  is  primarily 
done  on  avionics  equipments,^  and  replenishment  spares. 

For  source  selection  and  DSARC  II,  the  Air  Force  uses  both 
the  total  system  cost  factors  model  and  a detailed  equipment 
level  logistic  support  cost  model  that  provides  cost  estimates 
for  avionics  and  other  individual  equipments  in  several  cost 
categories,  including  initial  and  replenishment  spares  and  base 


*The  Cost  Analysis  Cost  Estimating  (CACE)  model  is  in  Air  Force  Regulation 
173-10,  USAF  Cost  and  Planning  Factors,  and  is  discussed  in  part  B,  section 
3 of  this  chapter. 

^Ihe  regression  equations  are  presented  in  the  F-l8  aircraft  program 
DSARC  II  documentation,  and  discussed  in  part  C,  section  3 of  this  chapter. 
Other  cost  categories  include  enlisted  maintenance  personnel,  depot  mainte- 
nance airframe  rework,  depot  engine  revt'oric,  POL,  and  other  consumables. 
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and  depot  maintenance.'  The  Nav;-  continues  to  rely  on  its 
weapon  system-level  rep:resslon  eouations  and  introduces 
individual  component  level  methodolop^ies  following  the  DSARC  II 
milestone.  These  methodologies  Include  an  internal  Navy  cost 
tracking  model^  and  a Jointly  developed  Navy  and  prime  airframe 
contractor  detailed  equipment  level  model. ^ 

Several  other  models  are  applied  by  the  Services  to 
individual  elements  of  support  costs,  but  these  models  are  not 
compreheslve  support  cost  estimating  methodologies  that  address 
at  a minimum  the  costs  of  maintenance  at  all  levels  and  spares 
and  repair  parts  support. 

This  chapter  examines  these  various  methodologies  and 
models  in  terms  of  their  potential  usefulness  to  OSD  for  pro- 
viding avionics  support  cost  estimating  capabilities  early  in 
the  acquisition  cycle.  The  actual  assessments  of  these 
methodologies  a. id  models  are  oresented  in  Chapters  IV  and  V. 

The  emphasis  in  this  chapter  is  on  describing  the  specific 
models  to  reveal  their  structures  and  assumptions.  The  signifi- 
cance of  the  roles  these  models  play  in  the  Services  is  not  a 
measure  of  the  attention  devoted  to  them  in  this  chapter.  As 
an  example,  the  Air  Force  CAGE  historical  factors  model  is  a 
major  Air  Force  tool  for  weapon  system-level  estimates,  but 
it  is  treated  relatively  lightly  in  this  chapter  because  its 
application  potential  for  estimating  avionics  component  support 
costs  is  limited.  In  contrast,  the  roughly  equivalent  Navy 


'The  Air  Force  Logistics  Conmand  (AFLC)  Logistics  Support  Cost  (LSC)  Model, 
discussed  in  part  B,  section  3 of  this  chapter. 

^The  cost  tracking  model  as  used  uy  the  Navy  for  the  F-l8  development  pico- 
gram  is  solely  intended  as  a baseline  generator  against  which  changes  in 
comonent  support  costs  can  be  monitored;  it  is  not  Intended  in  any  wav 
as  a generator  of  component  support  cost  actuals.  However,  it  offers  a 
potential  approach  that  could  generate  actual  cost  estimates.  See  part  C, 
section  3 of  this  chapter. 

’ihe  F-l8  McDonnell  Douglas  equipment  level  support  cost  model  is  discussed 
in  part  C,  section  3 of  this  chapter. 
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regression  weapon  system-level  model  is  treated  in  substantial 
detail,  because  it  is  the  basis  for  a component  level  estimating 
technique  that  could  be  applied  early  in  the  acquisition  cycle. 

Data  systems  are  also  examined  that  currently  provide 
inputs  to  the  Service  estimating  models,  and  again  the  emphasis 
is  on  these  systems'  potentials  for  providing  inputs  to  early 
acquisition  cycle  models  useful  at  the  OSD  level. 

With  these  perspectives  in  mind,  we  first  examine  the  Air 
Force  methodologies,  policies,  and  data  systems,  and  then  we 
examine  those  of  the  Navy. 

B.  AIR  FORCE  METHODOLOGIES,  POLICIES,  AND  DATA  SYSTEMS 
1 . Introduction 

Support  costs  for  avionics  equipment  on  new  fighter  aircraft 
are  first  estimated  by  the  Air  Force  just  prior  to  the  full-scale 
engineering  development  decision  milestone  (DSARC  II).  Although 
these  support  cost  estimates  come  relatively  late  in  the  acqui- 
sition cycle,  this  should  not  be  interpreted  as  evidence  that 
they  cannot  be  made  earlier.  The  discussions  of  support  cost 
estimating  methodologies  presented  in  this  section  of  the  paper 
describe  the  current  Air  Force  techniques.  Because  these 
descriptions  are  structured  within  the  framework  of  current 
programs  like  the  F-l6  Air  Combat  Fighter  (ACF),  the  descrip- 
tions necessarily  relate  to  how  and  when  cost  estimates  are 
currently  produced.  But  the  timing  in  the  acquisition  process 
of  when  equipment-level  cost  estimates  first  appear  is  a matter 
of  policy,  not  necessity  dictated  by  the  lack  of  methodologies 
and  techniques.  We  believe  that  many  cost  estimating  techniques 
can  be  applied  at  any  time  during  the  acquisition  process,  and 
further  that  the  applications  of  specific  techniques  discussed 

I 

in  this  section  can  be  implemented  at  any  time  given  certain 
assumptions  about  the  data  that  provide  inputs  into  them.  These 

V 

assumptions  are  presented  later  in  the  discussion  of  data  systems. 
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The  major  policies  and  procedures  guiding  the  Air  Force 
cost  estimating  efforts  are  the  recently  revised  DoDDs  5000.1, 
5000.2,  and  4105.62,  the  source  selection  directive. 

Based  on  these  policies  and  procedures,  the  Air  Force  uses 
several  specific  cost  estimating  methodologies  embodied  in  the 
following  major  cost  estimating  models  and  methods: 

(1)  AFLC  Logistic  Support  Cost  (LSC)  model, 

(2)  Logistics  Composite  Model  (LCOM), 

(3)  MOD-METRIC  Model, 

(4)  Optimum  Repair  Level  Analysis  Model  (ORLA), 

(5)  Parametric  regression  equations  models. 

The  key  data  and  management  information  systems  that  relate 
to  avionics  support  costs  include: 

(1)  Operating  and  Support  Cost  Estimating  Reference 
(OSCER)  System, 

(2)  Increase  Reliability  of  Operational  Systems  (IROS) 

Data  Management  System  (K051), 

(3)  Maintenance  Actions,  Manhours,  and  Aborts  by  Work 
Unit  Code  Reporting  System  (D056), 

(4)  Aerospace  Vehicle  Inventory,  Status,  and  Utiliza- 
tion Reporting  System  (AVISURS)  (G033), 

(5)  Aircraft  Inertial  Navigation  System  Performance, 

Test,  and  Diagnostic  Analysis  System  (GO78C), 

(6)  Actuarial  Analysis  Program  (D057F), 

(7)  Economic  Ordering  Quantity  Data  Bank  (D062), 

(8)  Depot  Maintenance  Industrial  Fund  Cost  Accounting 
Production  Report  (HO36B). 

2 . Policies  and  Procedures 

Air  Force  policies  and  procedures  for  estimating  avionics 
support  costs  on  fighter  aircraft  are  not  explicitly  differen- 
tiated from  general  cost  estimating  policies  and  procedures 
that  the  Air  Force  has  established  to  comply  with  the  DoD 
directives  discussed  in  Chapter  I. 
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The  Secretary  of  Defense  decision  at  DSARC  0 is  based  on 
documentation  contained  in  the  Mission  Element  Need  Statement. 

The  MENS  does  not  normally  contain  cost  estimates;  however, 
cost  data  may  be  required  of  the  Air  Force  if  the  mission  need 
for  a new  system  acquisition  is  identified  in  terms  of  a maior 
cost  saving  advantage  over  an  existing  system.  In  this  situa- 
tion, cost  estimates  even  at  the  DSARC  0 milestone  decision 
would  become  relevant  for  Air  Force  action.  Whether  the  cost 
estimates  would  be  displayed  at  the  two-digit  work  unit  code 
level,  called  the  "system  level,"  or  in  greater  detail  at  the 
LRU  or  SRU  level,  would  depend  on  the  specific  mission  need 
and  cost  saving  opportunity.  Thn  possibility  certainly  exists 
that  detailed  cost  estimates  cou  d be  required  at  DSARC  0 for 
inclusion  in  a MENS  documentation.  At  this  time  Air  Force 
policy  does  not  explicitly  require  cost  estimates  at  DSARC  0, 
but,  as  will  be  explained  later,  parametric  regression  cost 
estimating  equations,  manpower  simulations  models,  and  the 
AFLC  Logistic  Support  Cost  Model  could  be  used  to  provide 
DSARC  0 cost  estimates. 

At  the  end  of  the  conceptual  phase,  when  the  Air  Force 
wishes  to  secure  SECDEF  approval  for  system  demonstration  and 
validation,  a draft  Decision  Coordinating  Paoer  (DCP)  is  pre- 
pared which  contains  the  System  Project  Office  (SPO)  cost  esti- 
mates and  an  Independent  Cost  Analysis  (ICA)  is  conducted.  The 
DCP  and  the  supporting  ICA  are  forwarded  to  OSD  as  oart  of  the 
input  for  the  DSARC  I milestone  decision.  The  draft  DCP  con- 
tains the  initial  weapon  system  level  cost  of  ownershin  estimates 
for  the  system  under  construction,  and  is  based  on  the  Cost 
Analysis  Cost  Estimating  (CACE)  Model  discussed  later  in  this 
paper.  These  estimates  do  not  include  support  costs  for  avionics 
at  the  equipment  level.  The  recurring  investment  and  miscel- 
laneous logistics  costs  calculated  by  the  CACE  model  Include 
common  AGE  replacement  and  spares,  aviation  fuel,  base  level 
maintenance  material,  depot  level  labor  and  material  maintenance. 
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Class  IV  modifications  and  their  initial  spares,  training  muni- 
tions, replenishment  spares,  and  vehicular  equipment. 

Accompanying  the  SPO  estimates  that  go  into  the  DCP  are 
ICA  estimates  prepared  by  APSC  headquarters  using  the  CAGE 
model  equations  and  factors.  It  is  also  in  this  conceptual 
phase  draft  DCP  that  the  APLC  LSC  model  is  identified  as  the 
basis  for  equipment  level  operating  and  support  cost  submissions 
by  the  potential  contractors  to  the  Air  Porce  and  intended  for 
use  in  the  source  selection  process.  This  identification  of 
the  LSC  model  as  a source  selection  requirement  placed  on  the 
contractor  is  the  initial  formal  specification  of  an  Air  Porce 
requirement  for  equipment-level  support  cost  estimates.  The 
LSC  model  will  be  run  by  the  contractors  prior  to  source  selec-  ' 
tlon,  but  its  first  official  submittal  to  the  Air  Porce  comes 
at  the  time  of  the  demonstration  for  the  source  selection 
decision.  This  submittal  to  the  Air  Porce  only  comes  as  the 
process  nears  the  source  selection  phase  Just  prior  to  a SECDEP 
DSARC  II  full-scale  development  decision. 

Poliowing  an  affirmative  SECDEP  DSARC  I (program  valida- 
tion and  documentation)  decision,  the  validation  and  demonstra- 
tion phase  of  the  acquisition  process  is  entered.  This  phase 
culminates  in  the  preparation  of  a DCP  and  an  ICA  upon  which 
the  source  selection  and  the  DSARC  II  full-scale  development 
decision  are  based.  Por  the  SPO  DCP  estimates  the  parametric 
CAGE  model  is  used  again  to  preserve  consistency  in  comparing 
the  DSARC  II  with  the  DSARC  I cost  estimates;  in  addition,  the 
LSC  model  is  exercised  using  test  data  to  estimate  reliability 
and  maintainability  characteristics  of  individual  components. 
Initial  and  replenishment  spares  costs  are  developed  using 
spares  optimization  models,  and  base  level  maintenance  require- 
ments are  developed  through  the  use  of  maintenance  manpower 
simulation  models.  These  techniques  permit  the  Air  Porce  to 
provide  equipment  level  avionics  support  costs  at  the  conclusion 


of  the  validation-demonstration  phase  as  part  of  the  docu- 
mentation for  source  selection  and  the  full-scale  development 
decision. 

The  ICA  relies  on  parametric  regression  CAGE  model  equa- 
tions even  at  DSARC  II,  and  where  possible,  checks  equipment- 
level  costs  against  system  performance  estimates,  limited  test 
data,  specific  design  characteristics,  and  limited  detail  design 
and  preliminary  make  or  buy  lists.  Using  these  data,  selected 
equipment  acquisition  costs  can  be  estimated  by  hand.  Some 
support  costs  can  be  estimated  by  using  these  equipment  acqui- 
sition costs  as  independent  variables  in  parametric  equations. 

Following  the  DSARC  II  decision,  equipment-level  avionics 
support  costs  are  available  throughout  the  remaining  segments 
of  the  acquisition  process. 

Prior  to  DSARC  II,  all  cost  estimates  are  preliminary  and 
flexible,  but  the  estimates  approved  in  the  DSARC  II  decision 
become  management  values  used  by  the  Air  Force  and  the  SPO 
against  which  to  measure  contractor  performance.  The  fact  that 
the  cost  estimates  are  not  binding  until  an  affirmative  DSARC 
II  decision  does  not  diminish  the  usefulness  of  pre-DSARC  II 
cost  estimates  for  avionics  equipment  at  two-digit  and  five- 
digit  WUC  levels. 

3.  Cost  Estimating  Methods 

a . Overview 

The  cost  estimating  methods  discussed  here  include  all  the 
major  methods  touched  on  in  the  preceding  discussion  of  policies 
and  procedures,  but  only  those  methods  that  provide  avionics 
equipment  level  OiS  costs  are  described  in  detail.  In  addition, 
some  recent  exploratory  work  on  avionics  O&S  cost  estimating 
methods  is  discussed,  particularly  the  activities  monitored 
through  the  Air  Force  Avionics  Laboratory  (APAL)  at  Wright- 
Patterson  Air  Force  Base. 


b . AFLC  Logistic  Support  Cost  (LSC)  Model 
( 1 ) Basic  Structure 


The  AFLC  LSC  model  is  the  major  Air  Force  cost  estimating 
techinque  that  provides  O&S  estimates  at  the  detailed  equipment 
level,  including  avionics  equipment.  The  LSC  User's  Handbook ^ 
August  1976,  describes  the  model  as  an  analytical  accounting 
model.  The  analytical  descriptor  indicates  that  it  yields 
specific  point  values  Instead  of  frequency  distributions  of 
ranges  of  values.  The  accounting  descriptor  indicates  that  it 
calculates  costs  for  small  detailed  levels  of  equipment  and 
aggregates  them  to  produce  values  for  the  entire  system  of 
which  the  detailed  equipments  are  the  constituent  parts. 


The  model  contains  ten  basic  equations,  one  for  each  of 
ten  "logistic  support"  costs.  The  costs  (equation  names)  and 
their  single  symbol  identifiers  are: 


cost  of  first  line  unit  (FLU)  spares 

cost  of  FLU  on-equlpment  maintenance 

cost  of  FLU  off-equipment  maintenance 

cost  of  FLU  Inventory  management 

cost  of  FLU  support  equipment 

cost  of  personnel  training  for  FLU's 

cost  of  FLU  management  and  technical  data 

cost  of  facilities 

cost  of  fuel  consumption 

cost  of  spare  engines. 


The  first  three  costs,  C^,  C^,  and  constitute  support 
costs  that  are  relevant  for  the  task  (DP&E-llO)  addressed  in 
this  paper.  The  equation  structures  for  each  of  these  costs  ■ 
are  presented  in  the  figures  to  follow.  In  addition,  the 
equation  structure  for  support  equipment  costs  is  also  examined. 
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( Z ) Spares  costs 

Figure  1 displays  the  structure  of  the  spares  costs  equa- 
tion in  the  LSC  model.  The  first  two  elements,  and  C,.,, 

11  liL 

compute  Initial  spares  costs  at  base  and  depot,  respectively, 
while  the  third  element  computes  replenishment  spares.  The 
quantities  of  initial  spares  are  computed  based  on  the  peak 
level  of  program  activity  rather  than  an  incremental  build-up. 

The  critical  term  in  the  initial  base  pipeline  equation 
(C^^)  is  STK^ , which  is  the  number  of  spares  of  the  i^^  FLU 
required  for  each  base  to  fill  the  base  repair  pipeline 
including  a safety  stock  to  prepare  for  random  demand  fluctua- 
tions. As  seen  in  Figure  1,  STK^  is  based  on  the  mean  demand 
rate  per  base  (X^),  the  weighted  pipeline  time  (t^),  and 
expected  backorders  (EBO) — the  established  standard  time  for 
expected  weapon  system  backorders.  The  details  of  each  of 
these  elements  require  substantial  input  data  from  both  con- 
tractors and  the  Air  Force.  Since  the  equation  sums  costs 
across  all  FLUs , this  complex  equation  STK^  is  calculated  once 
for  each  FLU  in  the  system.  Detailed  FLU  input  values  such  as 
MTBF,  NRTS  rates,  the  fraction  of  FLUs  required  in  place,  and 
the  average  number  of  hours  to  fault-isolate , remove,  and 
replace  each  FLU  are  all  required  to  calculate  the  STK^^  base 
spares  pipeline.  Once  STK^  is  calculated  for  each  FLU,  it  is 
multiplied  times  the  Initial  provisioning  FLU  cost  of  each  FLU, 

and  these  calculated  costs  are  all  summed  to  produce  the  initial 

> 

base  spares  cost  estimate, 

The  depot  Initial  spares  cost  estimate,  is  less  com- 

plex than  for  base  spares  but  also  requires  specific  FLU  input 
data  including  MTBF,  NRTS  rates,  and  fraction  of  failed  FLUs 
repaired  in  place,  for  each  FLU.  Based  on  these  variables, 
the  complex  term  in  ^12  calculates  a quantity  of  initial  depot 
spares  for  each  FLU.  These  FLU  quantities  are  multiplied  times 
their  respective  Initial  provisioning  costs  and  them  summed  to 
produce  total  depot  initial  spares  cost. 
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The  rep!' enlshment  spares  element,  also  requires 

specific  support  characteristic  data  for  each  FLU:  MTBP,  base 
condemnations,  fraction  of  failed  FLUs  repaired  in  place,  ratio 
of  operating  to  flying  hours,  and  number  of  like  FLUs  in  the 
parent  system.  Again,  the  complex  term  calculates  spares 
quantities  and  the  quantities  are  multiplied  times  their 
acquisition  prices  and  the  total  replenishment  spares  costs  is 
calculated . 

( 3 ) On-Equipment  Maintenance  Cost 

Figure  2 displays  the  structure  of  the  on-equipment  FLU 
maintenance  cost  equation,  C^,  where  it  is  composed  of  the 
manhour  cost  to  perform  flight-line  maintenance  on  FLUs  due 
to  unscheduled  failures  (C^-j^),  and  the  manhour  cost  to  perform 
scheduled  maintenance  (0^2)  - As  would  be  expected,  the 
unscheduled  on-equipment  maintenance  equation  element  requires 
detailed  manhour  data  for  each  FLU,  including  the  average  man- 
hours to  fault-lsolate , remove  and  repair  each  FLU,  the  on-time 
corrective  maintenance  manhours  per  FLU,  and  the  in-place 
preparation  and  access  manhours.  Besides  the  manhour  data  by 
FLU,  additional  FLU  level  detail  data  is  required  in  the  forms 
of  the  fraction  of  failed  FLUs  repaired  in  place  and  MTBF. 

The  scheduled  maintenance  element,  ^^23  is  not  dependent 
on  detailed  FLU  data.  It  is  simply  the  total  force  flying 
hours  divided  by  the  flying  hour  interval  between  scheduled 
maintenance  actions  (scheduled  periodic  or  phased  Inspections) 
for  the  aircraft  multiplied  times  the  base  labor  rate  and  the 
average  manhours  to  perform  a scheduled  maintenance  action. 


(4)  Off-Equipment  Maintenance  Cost 


Figure  3 shows  the  complex  structure  of  the  off-equipment 
FLU  maintenance  cost  equations!  The  element  calculates  th 
number  of  failed  removed  FLUs  subject  to  maintenance  action. 
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1.  ■ e«$t  of  FLU*  tporos  • 

tfOtro  C|^  • cost  of  Initial  base  spares. 


C||  ■ cost  of  replenlshaent  spares. 


1^23  IST«,)(yc,) 

I ^ — * 


Initial  provisioning  FLU  cost 
NuBber  of  bases 

Total  nuaber  of  FLU'S  In  system 


STK.  • Minimum  number  of  spares  of  the 
1th  FLU  required  fjr  each  base 
to  fill  the  repair  pipeline 
Including  a safety  stock. 


EBO  ■ expected  backorders  - number  of  -i 
existing  at  the  lowest  echelons  , 


kj  > mean  demand  rate  per  base 


• (PFFH)(QPA^ ){UF^)(1-RIP^)/M(MTBF 


t^  ■ weighted  pipeline  time 

- (RTS^)(BRCT)  ♦ {NRTS,)(0ST) 


J.  C,J  • 51  (PfFH)(QPA()(UF,  )(1-II|P,)(N«TS))(0»CT) 

I I I "'“'I  I I 


— • Initial  provisioning 


I—*  Initial  provisioning  FLU  cost 

Depot  repair  cycle  time 

— Not  repairable  this  station 

Fraction  of  failed  FLU'S  repaired  In  place* 
— — Mean  time  before  failure 

'•Ratio  of  operating  t»  flyinr  hours 

— Number  of  FLU'S  In  parent  system 
— “•Peak  force  flying  hours 
•Total  number  of  FLU’s  in  system 


«.  tl3  -S  (TTFH)(QPA,)(UP.)l.«IP|)(COt|D,) 
I I AT»F,  I I 


' Initial  provisioning  FLU  cost 

•Base  condemnation  proportion  of  failed  FLU'S 

•Fraction  of  failed  FLU's  repaired  In  place* 

•Ratio  of  operating  to  flying  hours 

- — •Mean  time  before  failure 

—Number  of  like  FLU's  in  parent  system 

•Total  force  flying  hours 

-—Total  number  of  FLU's  in  system 


m i'«m  (Fiyl  *s  the  first  level  of  assei^ly  below  the  two-digit  work  unit  code  (UUC)  equipment  level  that  Is  carried  as  a line  Item  of  supply  at  base  level.  It  It  utuallv  « 
*•  te  return  the  equipment  to  an  operational  condUion.  A lower  level  subassembly  within  a FLU.  called  a Shop  Replaceable  Unit  (SRU),  that  Is  required  or  replaced  1 

•••  •ema-rea  «•  p'ace.  is  a nt^r  giving  the  fraction  of  failed  FLU's  repaired  In  place.  The  complete  term  1-RlP^.  Is  a number  giving  the  fraction  of  failed  FLU's  not  repel 

-#  1.  SPARES  COST  EQUATION  STRUCTURE  IN  THE  AFLC  LOGISTIC  SUPPORT  COST  MODI 
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• •Kpected  backorders  - nunber  of  unfilled  deainds 
ex1st1n9  et  the  lowest  echelons  at  any  point  In  tin 

* Xf  ■ Mean  denand  rate  per  base 


^ 


Mean  tine  (flying  hours)  before 
failure 


' Nunber  of  bases 

Fraction  of  failed  FLU'S  repaired 

1 n place' 

-»  Ratio  of  operating  to  flying  hours 
—»  Nunber  of  FLU'S  In  parent  system 
•Peak  force  flying  hours 


tf  ■ weighted  pipeline  tine 

• (RTS^){8RCT)  * (NRTS,)(0ST) 


in. 5,  / 


• Order  and  shipping  tine  In  months 
•Not  repairable  this  station 
‘Average  base  repair  cycle  In  months 

‘Average  nunber  of  hours  to  fault 
Isolate,  remove  and  replace. 


In  place' 


r 


failed  FLU'S 
Id  In  place' 


lysten 


■ called  a Shop  Replaceable  Unit  (5RU),  that  Is  required  or  replaced  only  at  intenvdiate  level  shops  Is  not  defined  a 
t term  1-RJPj,  Is  a number  giving  the  fraction  of  failed  FLU'S  not  repaired  In  place. 


Where:  X.t^  • expected  number  of  demands 
on  supply  for  the  1th  FLU 
over  Its  average  base 
repair  pipeline  tine. 


Find:  A nininum  value  of  STK  such 
that. 


(«-STK,)(,(,  CBO 

x>STK| , and  p(x  t ^ ) Is  a 

Poisson  distribution  of  the 
probabilities  of  demand  X 
given  mean  denand  X^t^. 


replaced  on  the  coid>lete  system 
IS  a FLU. 


FLC  LOGISTIC  SUPPORT  COST  MODEL 


1.  C2  * cost  of  on-equipment  FLU‘  maintenance  = + C 
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Where:  Cg  = manhour  cost  to  perform  on-equipment  (flight  line)  maintenanq 


system  life. 

C22  = manhour  cost  to  perform  scheduled  maintenance  on  the  completi 


2. 


'21 


r-N 

E 

i*l 


(TFFH)(QPA.)(UF^) 


mtbf. 


(RIPi)( 


MH^) 


+ ( 


-RIP^)(RMH.)](BLR)  { 


Bli 


Average  ma 

I 

Fraction  of  fail" 


►On-time  corrective  mainten 
Fraction  of  failed  FLU's  repaire 
In-place  preparation  and  access  manhour^ 
Ratio  of  operating  to  flying  hours 
Number  of  like  FLU's  in  parent  system 
Mean  time  between  failure 
Total  force  flying  hours 
Total  number  of  FLU's  in  system 
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l-TFFH 


SMI 


(SMH){BLR) 


-Base  labor  rate 
'Average  manhours  to  perform  scheduled  periodic  or  j 
•Flying  hour  interval  between  scheduled  periodic  or 
'Total  force  flying  hours 


‘A  First  Line  Unit  (FLU)  is  the  first  level  of  assembly  below  the  two-digit  Work  Unit  Code  (Wfl 
at  base  level.  It  is  usually  the  highest  level  of  assembly  that  is  removed  and  replaced  on  1 
equipment  to  an  operational  condition.  A lower  level  sub-assembly  within  a FLU>  called  a Shg 
at  intermediate  level  shops  is  not  defined  as  a FLU. 

*The  term  RIP^,  repaired  in  place,  is  a number  giving  the  fraction  of  failed  FLU's  repaired  ij 
fraction  of  failed  FLU's  not  repaired  in  place. 

’The  variables  in  this  bracketed  term  constitute  the  weighted  average  on-equipment  maintenance 
and  access  time  and  either  in-place  repair  or  removal  and  replacement. 


Figure  2.  ON-EQUIPMENT  MAINTENANCE  COST  EQUATION  IN  THE  AFLC  LOGISTIC  SUP, 
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nc6  * ^21  ^22 

n-equipment  (flight  line)  maintenance  on  FLU's  due  to  unscheduled  failures  over  the 
cheduled  maintenance  on  the  complete  system  over  the  life  cycle. 


MH^) 


+ ( 


A' 


-RIPJ{RMH,.)](BLR) 

1 — ►Base  labor  rate 

Average  manhours  to  fault  isolate,  remove  and  repair 
Fraction  of  failed  FLU's  repaired  in  place^ 

On-time  corrective  maintenance  manhours 
L*Fraction  of  failed  FLU's  repaired  in  place 
ace  preparation  and  access  manhours 
operating  to  flying  hours 
like  FLU’s  in  parent  system 
between  failure 
^e  flying  hours 
fcber  of  FLU's  in  system 


s to  perform  scheduled  periodic  or  phased  inspection 
^erval  between  scheduled  periodic  or  phased  inspection 
^Ing  hours  

»ly  below  the  two-digit  Work  Unit  Code  (WUC)  equipment  level  that  is  carried  as  a line  item  of  supply 
(assembly  that  is  removed  and  replaced  on  the  complete  system  or  sub-system  in  order  to  return  the 
Irel  sub-assembly  within  a FLU,  called  a Shop  Replaceable  Unit  (SRU),  that  is  repaired  or  replaced  only 

hg  the  fraction  of  failed  FLU's  repaired  in  place.  The  complete  term  1-RIP^,  is  a number  giving  the 

I weighted  average  on-equipment  maintenance  manhours  per  failure  of  the  i^^  FLU  including  preparation 
Ml  and  replacement. 


[EQUATION  IN  THE  AFLC  LOGISTIC  SUPPORT  COST  MODEL 


FIELD 

Field 


2: 

3: 


FIELD 

FIELD 


h: 

5: 


FLD/GRP(S) 
ENTRY  class 

NTIS  PRICES 
SOURCE  NAME 


FIELD 

26: 

abstract  class. 

FIELD 

29: 

INITIAL  INVENTORY 

FIELD 

3o: 

annotation 

FIELD 

31 : 

special  indicator 

FIELD 

32: 

regrading  category 

FIELD 

33: 

limitation  codes 

FIELD 

3<«; 

SOURCE  serial 

FIELD 

35: 

SOURCE  CODE 

FIELD 

3a: 

document  location 

FIELD 

37: 

classified  by 

FIELD 

3e: 

declassified  on 

FIELD 

39: 

downgraded  to  conf 

FIELD 

<tO! 

GEOPOLITICAL  CODE 

^jE^ 

<♦1 : 

SOURCE  type  code 

ISOSO  OSOIO 
U 


HC  HF  ] 

institute  for  defense  analyses  aRLINGTO] 


FIELD 

6 : 

unclaSs,  Title 

the  feasibility  of 
acquisition  CYCLE* 

FIELD 

7 ; 

class,  title 

field 

8: 

title  class. 

u 

FIELD 

9; 

descriptive  NOTE 

FINAL  REPT,  17  JAN 

FIELD 

10: 

personal  authors 

MOrGAN,JOHN  D.  IFUL 

FIELD 

1 1 : 

REPORT  date 

SEP  77 

FIELD 

12: 

pagination 

2‘»<*P 

FIELD 

13: 

SOURCE  ACRONYM 

FIELD 

im; 

REPORT  number 

P-I292-V0L-1 

FIELD 

is: 

CONTRACT  Number 

0AHC15-73-C-0200 

FIELD 

16: 

PROJECT  number 

FIELD 

17: 

Task  number 

FIELD 

16: 

monitor  Source 

ida/HQ 

FIELD 

19: 

MONITOR  SERIES 

77-19730 

field 

20: 

Report  class 

FIELD 

21 : 

supplementary  note 

SEE  ALSO  VOLUME  2, 

FIELD 

22: 

ALPHA  limitations 

distribution  of  doc 
analysis  and  evalua 
available  from  OqC* 

FIELD 

23: 

descriptors 

•LOGISTICS  support, 
PROCUREMENT 

FIELD 

2h: 

descriptor  class* 

U 

FIELD 

25: 

identifiers 

FIELD 

2*: 

identifier  class. 

FIELD 

27; 

ABSTRACT 

THIS  PAPER  reports 

volume  i;  the  basic 


AO-EBOO  02*» 


riON),  MASHiNGTONt 
cataloging  inform*] 
•AVioNICSi  .COST  e 


ON  research  tO  OETCJ 
IN  THE  SYSTEM  AcOOlSiT 


ESTIMATE!  early  . _ . 

alternative  AVIONICS  components  ENVISI^ 
aircraft,  support  COSTS  a’^e  defined  AS: 

INTERMEDIATE  AND  DEPOT  lEVElS  Tq  MAINTJ 

SPARES  AND  REPAIR  PARTS  SUPPORT,  ThE  R 
VOLUMES.  VOLUME  I REVIEWS  AND  EVALUATE 

AIR  FORCE  and  NAVY  TO  ESTIMATE  THESE 
relevant  industry  and  defense  STUDIES! 

systems  that  could  provide  data  needei^ 

DISCUSSES  THE  FEASIBILITY  OF  OEvELOPInI 
recommendations  on  THE  BEST  METhOOS  TO 
PROBLEM  at  OSaRC  0,  I,  aND  II»  THE  PAR 

dSaRc  process,  it  discusses  major  concI 
FUTURE  SUPPORT  COSTS  FOR  EQUIPMENT  STl 

PAPER  concludes  ThAT  iS  FEASiBLE  AND  0| 
SUPPORT  COSTS,  THE  SPECIFIC  METhOD  TO 

OSO  WISHES  TO  devote  TO  THIS  EFfORT, 

U 


1 21 
F 

<•03525 

7 


.J 


5110 

W 


r' 

15050  05010 
U 

I 


HC  MF 

institute  for  defense  analyses  ARLINGTON  Va  COST  ANALYSIS  GROUP 


the  feasibility  of  estimating  avionics  support  costs  EaRLY  in  The 
acquisition  cycle*  volume  i;  the  basic  report. 

u 

FINAL  REPT,  1?  JAN  - SEP  77, 

MOrGANiJOHN  D.  SFULLERiAARON  B*  I 

SEP  77 
2MRP 

P-1292-V0L-1 

0AHC15-73-C-0200 


IOA/HQ 

77-19730 

iL 

SEE  ALSO  VOLUME  2,  AD-E500  02^. 

distribution  of  document  Controlled  by  assistant  secretary  qf  defense  (program 

analysis  and  EVALUATION!,  WASHINGTON,  DC  20301,  THIS  DOCUMENT  IS  NOT 

available  from  OoC*  cataloging  information  supplied  BT  inA,  ARLINGTON,  VA* 

•LOGISTICS  support,  •AVIQNICS,  •COST  ESTIMATES,  LOgiSTIcS  PLANNING,  AIR  FORCE 

PROCUREMENT 

U 


THIS  paper  reports  ON  RESEARCH  T®  DETERMINE  THE  FEASIBILITY  OF  DEVELOPING  METHODS  TO 
estimate,  early  in  the  system  acquisition  CYCLE,  The  potential  SUPPORT  COST  INPUTS  OF 
alternative  AVIONICS  COMPONENTS  ENVISIONED  FOR  AlR  FORCE  AND  NAVY  FIGHTeR 

aircraft,  support  COSTS  aRE  defined  as  those  costs  incurred  aT  the  organizational, 

INTERMEDIATE  AND  DEPOT  LEVElS  Tq  MAINTAIN  AVIONICS  EQUIPMENT  AND  ThE  COSTS  Op  AViONiCS 

SPARES  AND  REPAIR  PARTS  SUPPORT,  The  RESULTS  OF  THe  STUdY  aRE  PRESENTED  IN  TWO 
VOLUMES.  VOLUME  1 REVIEWS  AND  EVALUATES  CURRENT  METHODS  USED  IN  INDUSTRY  AND  IN  THE 

air  force  and  navy  to  estimate  these  avionics  support  costs;  Reviews  and  evaluates 
relevant  industry  and  defense  Studies;  reviews  industry  and  dod  data  and  management 
systems  that  could  provide  data  needed  for  avionics  support  cost  estimating  techniques; 

DISCUSSES  THE  FEASIBILITY  OF  DEVELOPING  SUITABLE  ESTIMATING  TECHNIQUES!  AND  PRESENTS 
RECOMMENDATIONS  ON  THE  BEST  METHODS  TO  FOLLOW  IN  DEALING  WITH  THIS  COST  ESTIMATION 
PROBLEM  at  DSaRC  0,  i,  anO  |I.  THE  PAPER  PROVIDES  A COMPREHENSIVE  REVIEW  OF  THE 

OSaRC  process,  it  DISCUSSES  MAJOR  CONCEPTUAL  PROBLEMS  IN  DEVELOPING  ESTIMATES  OF 
FUTURE  SUPPORT  COSTS  FOR  EQUIPMENT  STILL  IN  THE  EARlT  DEVELOPMENT  STAGES.  FINALLY,  THE 
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This  is  multiplied  by  appropriate  calculated  costs  of  failure 
verification,  intermediate  and  depot  repair  costs,  and  trans- 
portation costs  for  NETS  PLUs  and  condemnation  replacements. 

The  maintenance  sequence  built  into  this  equation  is  that  all 
failed  FLUs  are  first  bench-checked  to  verify  failure  and  then 
either  repaired  at  the  base  intermediate  maintenance  shop  (the 
RTS  term  in  element  returned  to  the  depot  for  repair 

(the  NRTS  rate  in  element  or  condemned  (the  COND  term  in 

element  The  cost  of  failure  verification  results  from 

manhours  expended,  represented  by  average  manhours  to  erform 
shop  bench  check,  screening  and  fault  verification  (BCMH  in 
element  this  is  a contractor- furnished  input  variable 

for  each  FLU.  The  cost  to  repair  a FLU  results  from  direct 
repair  manhours  per  FLU  at  the  intermediate  (term  BMH  in  element 
0^2^  depot  (term  DMH  in  element  levels,  plus  the 

Implicit  repair  disposition  cost  to  stock  and  repair  lower 
indenture  components  and  assemblies  at  the  Intermediate  (term 
BMC  in  element  and  depot  (term  DMC  in  element  levels. 

This  implicit  repair  cost  is  for  lower  level  assemblies  such 
as  shop  replaceable  units  (SRUs)  needed  to  repair  FLUs. 


Figure  4 displays  the  structure  of  the  cost  of  FLU  support 
equipment,  and  this  is  the  most  complex  of  all  the  LSC  model 
equations.  The  heart  of  the  equation  is  elements 
and  These  elements  calculate  values  that  amount  to  a 

basic  queing  theory  equation,  where  the  number  of  pieces  of 
support  equipment  necessary  to  support  an  anticipated  workload 
is  calculated  as  a function  of  the  workload  arrival  rate 
the  service  rate  of  an  item  of  support  equipment  at  the  base 
(0^12)  and  depot  levels,  and  the  base  (term  BUR)  and 

depot  (DUR)  utilization  rates.  Given  the  calculations  of  the 
minimum  necessary  support  equipment  for  each  FLU,  the  equipment 
quantity  is  multiplied  times  the  per  unit  acquisition  and 


51 


support  costs  to  yield  total  life  cycle  costs  of  support  equip- 
ment used  to  repair  FLUs. 

(6)  LSC  Variables 

The  LSC  model  is  often  cited  as  being  complex  and  requir- 
ing many  data  outputs.  These  comments  are  usually  offered  as 
evidence  why  the  model  equations  can  only  be  used  once  the 
weapon  system  has  been  precisely  defined  at  least  down  to  FLU 
level.  There  are  ninety-five  separate  input  valables  provided 
at  different  levels  of  detail  by  both  the  government  and  the 
contractor.  Figure  5 shows  these  input  variables  for  the  wea- 
pon system  level,  the  propulsion  system  level,  and  the  support 
equipment  level.  Figure  6 shows  these  variables  for  the  system 
level  (two-digit  work  unit  code  level)  and  the  FLU  level.  Each 
of  the  system  level  variables  is  provided  for  each  two-digit 
WUC  piece  of  equipment;  each  FLU  variable  for  each  FLU;  and 
most  support  equipment  variables  for  each  piece  of  support 
equipment.  Hundreds,  perhaps  thousands  of  separate  values  of 
variables  are  required  to  operate  the  LSC  model  equations  at 
their  designed  levels  of  detail. 

In  addition  to  being  used  by  the  SPO  for  DCP  cost  esti- 
mates, the  LSC  model  equations  have  been  adapted  for  use  in  the 
ICA  at  the  DSARC  II  and  III  milestones  for  the  F-16  ACF,  and 
by  the  F-l6  SPO  to  compute  a set  of  target  logistic  support 
costs  (TLSCs)  by  LRU.  TLSC  reflects  conditions  at  the  time 
of  the  3500-f light-hour  test.  These  TLSCs  permit  quarterly 
tracking  of  the  high-cost  FLU's  to  direct  management  attention 
to  those  that  show  substantial  or  sudden  cost  growth  trends.^ 
These  multiple  uses  of  the  LSC  model  by  the  Air  Force  are 
evidence  of  its  operational  application  as  an  equipment-level 
support  cost  model. 


^F-26  Logistic  Support  Cost  Status  Report  (UL  76  AQ),  CDRL  Sequence  No.  A017, 
March  11,  1977. 
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Figure  4.  COST  OF  SUPPORT  EQUIPMENT  EQUATION  STRUCTURE  IN  AFLC  LOGISTIC  SUPPORT  COST  MODEL 


Nuiibtr  of  engines  per  aircraft  (EPA)* 

Engine  unit  cost  (expectation)  (EUC) 

Combined  Maintenance  removal  Interval  (CMRI) 
Engine  return  rate  (ERTS) 


Average  whole  engine  remove  and  replace 
manhours  (ERHH) 


Proportion  of  engine  overhaul  cost  to  unit 
cost  (COM) 

Fuel  consumption  rate  (FR) 


Depot  <^1rect  productive  manhours  per 
year  per  man  (PMO) 


CONUS  packing  and  shipping  cost  (PSC) 
Overseas  packing  and  shipping  cost  (PSO) 


Line  item  inventory  recurring  management 
cost  (NHC) 


•ase  supply  Item  Inventory  management  cost  (SA) 

Supply  transactions  records  manhours  per 
failure  (SR) 

Original  technical  documentation  cost  per 
pe9«  (TO) 

Total  force  flying  hours  (TFFH) 

Transportation  transactions  forms  manhours  per 
failure  (TR) 

Base  personnel  turnover  rate  (TRB) 

Oepot  personnel  turnover  rate  (TRD) 


PROPULSION  SYSTEM 


Engine  stock 
Automatic  suppl| 
Base  repair 
Depot  repal 
Per  unit  fuel 
Spare  engine 


Ir  cyei 
air  Cj4 


Expected  back  orders  (EBO) 

tine  Item  Inlefal  inventory  tfumgemertt  cost  (IMC) 
Number  of  Intermediate  repair  locations  (M) 
0ff>egu1 pment  maintenance  records  manhours  (MRF) 
0n-egu1pment  maintenance  records  manhours  (MRO) 
Number  of  systems  within  weaoon  system  (NSYS) 
Proportion  of  total  force  overseas  (OS) 

Order  and  shipping  time  In  months  (OST) 

Peak  force  flying  hours  (PFFH) 

Program  Inventory  usage  period  (PIUP) 

Base  level  direct  productive  manhours  per 
year  per  man  (PNB) 


WEAPON  SYSTEM  •- 


-•  (NONE) 


•Acronyms  in  parenthesis  following  each  variable  are  those  used  In  the  LSC  model. 

Figure  5 


AFLC  LOGISTIC  SUPPORT  COST  (LSC)  MODEL  INPUT  DATA  VARIABLES  AT  SUPPOl 
PROPULSION,  AND  WEAPON  SYSTEM  LEVELS 


h 
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COHTRACTQR-rURNISHED  INPUT  VARIABLES 


SUPPORT  EQUIPMENT 


Support  equipment  Identification,  up  to  20  characters  (XSE)* 
Base  level  utilization  rate  for  all  Items  of  equipment  (BUR) 
Base  shop  peculiar  support  equipment  cost  (CAB) 

Depot  peculiar  support  equipment  cost  (CAO) 

Annual  cost  to  operate  and  maintain  a unit  of  support 
equipment  at  base  level  as  a fraction  of  unit  cost  (COB) 
Maintenance  and  calibration  downtime  proportion  (DOWN) 

Depot  utilization  rate  for  all  Items  of  equipment  (DUR) 


Engine  stock  replacement  confidence  factor  (CONE) 
Automatic  suppljr  and  buildup  time  In  months  (ARBUT) 
Base  repair  cycle  In  months  (BR) 

Depot  repair  cycle  In  months  (DP) 

Per  unit  fuel  cost  (FC) 

Spare  engine  stockage  locations  (LS) 


WEAPON  SYSTEM  •- 


-i  (NONE) 
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ISC)  MODEL  INPUT  DATA  VARIABLES  AT  SUPPORl  EQUIPMENT 
I LEVELS 


um 


r 


GOVERNMENT  » FURNISHED  INPUT  VARIABLES 


Avi11«b1e  base  shop  manhours  per  man  per  month  (BAA)' 
Base  labor  rate  (BLR) 

Base  consumable  materfal  consumption  rate  (SMR) 
Average  base  repair  cycle  in  months  (BRCT) 

Available  depot  manhours  per  man  per  month  (OAA) 

Depot  Labor  rate  (DLR) 

Depot  consumable  material  consumption  rate  (OMR) 

Depot  repair  cycle  time  (DRCT)* 


SYSTEM  (2-Digit  WUC  Level  ) 


^ Work  Unit  Co« 
Name  of  systi 
Cost  of  addit 
Base  peculiai 
Existing  aut( 
Additional  cc 
Depot  peculii 
New  base  faci 
Pecul far  fl if 
Pages  of  depo 
Existing  autfl 
'%  Pages  of  orgi 
'•  Number  of  FLL 
Average  sched 
X \ » Flying  hours 
' Base  level  p« 
Depot  pecblla 
^ Pecul iar  trai 


(None)  ♦- 


FIRST  LINE  UNIT  (FLU, 
Digit  WUC  Level ) 


&-digit  WUC  ( 
Name  of  FLU  ( 


Average  manho 
veri fication 


SRU  implicit 
repaired  at  b 


Intermediate 
Base  condemn* 


SRU  implicit 
repaired  at  d 


Depot  mainten 
On- 1 i ne  corre 
Number  of  1 i n 
Mean  time  bet 
Fraction  of  r 
Number  of  new 
In-place  prep 
Number  of  new 
Number  of  1 ik 
Fraction  of  f 


Average  manho 
installed  syt 


Fi rs t - t ime  bp 
FLU  cost  at  1 
Use  factor-r* 
weight  of  flu 
Fraction  of  r 


'Acronyms  in  parenthesis  following  each  variable  are  those  used  In  the  LSC  moJel- 

*This  is  a weighted  average  in  months  • the  elapsed  time  for  a NATS  item  from  removal  of  the  failed  item  until  it  is  returned  to  depot  level  serviccabU  stock.  This  incl 
the  shop  flow  *1me  within  the  specialized  repair  activity  required  to  repair  the  item.  For  CONUS  contractual  repair  the  variable  acronym  changes  to  DRCTC,  and  for  overt 

'This  is  the  total  cost  of  peculiar  flight-line  support  equipment  and  additional  items  of  common  flight-line  support  equipment  per  base  required  for  Ihesystem. 

*This  is  the  average  cost  per  failure  for  a FLU  repaired  at  base  level  for  the  stockaqe  and  reoair  of  lower  level  assemblies  expressed  as  a fraction  of  FLU  unit  cost.  Tt 
indenture  repairable  components  within  the  FLU,  such  as  shoo  replacable  units  (SRU's). 

’Average  menhours  to  perform  maintenance  on  a removed  FLU  including  fault  Isolation,  repair,  and  verification 


•This  1$  the  averaoe  cost  per  failure  for  the  stockage  and  repair  of  lower  level  assemblies  used  to  repair  failed  FLU'S  at  the  depot.  The  cost  is  expressed  as  a fractlw 
♦mounts  to  implicit  costs  for  labor,  material,  and  stockaqe  of  lower  indenture  repairable  components  within  the  FLU,  conponents  such  as  SRU's. 


’Number  of  parts  already  stock-numbered  (standard  parts)  in  the  FLU  which  bases  will  manage  for  the  first  time  when  the  system  is  deployed 

Figure  6 


AFLC  LOGISTIC  SUPPORT  COST  (LSC)  MODEL  INPUT  DATA  VARIABLES  AT  TWO-DIG 
CODE  (WUC)  LEVELS 
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SYSTEM  (2-Digit  WUC  Level ) 


CONTRACTOR  - FURNISHED  INPUT  VARlARifS 

Work  Unit  Code  (XSYS)' 

Name  of  system  (SYSNOUN) 

Cost  of  additional  common  base  shop  support  equipment  per  base  (6CA) 
Base  peculiar  shop  support  equipment  cost  per  base  (BPA) 

Existing  automatic  test  equipment  software  cost  US) 

Additional  common  depot  support  equipment  cost  (OCA) 

Depot  peculiar  support  equipment  cost  (DPA) 

New  base  facilities  cost  (FO) 

Peculiar  flight-line  support  equipment  cost  per  base  (FLA)* 

Pages  of  depot  technical  orders  and  special  repair  Instructions  (H) 
Existing  automatic  equipment  Interconnecting  hardware  cost  (IH) 

Pages  of  organisation  and  Intermediate  technical  orders  (JJ) 

Number  of  FLU's  In  the  system  (M) 

Average  scheduled  periodic  or  phased  Inspection  manhours  (SMH) 
Flying  hours  between  scheduled  periodic  or  phased  Inspections  (SHI) 
Base  level  peculiar  training  cost  per  man  (TCB) 

Depot  peculiar  training  cost  per  man  (TCO) 

Peculiar  training  equipment  cost  (TE) 


I 

( FIRST  LINE  UNIT  (FLU.  5- 
} Digit  UUC  Level ) 


t 

I 


i 


5-dig1t  WUC  (XFLU) 

Name  of  FLU  (FLUNOUN) 

Average  manhours  to  perform  shop  bench  check,  screening,  and  fault 
veri ficatlon  (BCMH)  t 

SRU  Implicit  labor,  material  and  stockage  cost  per  failure  for  FLU 
repaired  at  base  (BMC)** 

Intermediate  maintenance  average  manhours  (BMh)* 

Base  condemnation  proportion  of  removed  FLU'S  (CONO) 

SRU  Implicit  labor,  material  and  stockaqe  cost  per  failure  for  FLU‘ 
repaired  at  depot  (DMC) 

Depot  maintenance  average  manhours  (OMH)* 

On-line  corrective  maintenance  manhours  without  removal  (IHH) 

Number  of  line  Items  of  peculiar  shop  support  equipment  (K) 

Mean  time  between  failure  (MTRF) 

Fraction  of  removed  FLU’S  returned  to  depot  (NRTS) 

Number  of  new  P-coded  repairable  assemblies  In  FLU  (PA) 

In-place  preparation  and  access  manhours  (PAMH)  i 

Number  of  new  P-coded  consumables  within  FLU  (PP) 

Number  of  like  FLU's  in  parent  system  (QPA)  ' 

Fraction  of  failed  FLU's  reoaired  In-place  (PIP) 

Average  manhours  to  fault  Isolate,  remove  and  replace  FLU  on 
installed  system  (RMH)  ^ 

First-time  base-managed  standard  parts  In  FLU  (SP)*  ! 

FLU  cost  at  Initial  provisioning  (UC)  | 

Use  factor-ratio  of  operating  to  flying  hours  (UF)  I 

Weight  of  FLU  In  pounds  (W) 

Fraction  of  removed  FLU's  repaired  at  base  level  (RTS)  | 


[filled  Item  until  It  is  returned  to  depot  level  serviceable  stock.  This  Includes  the  time  required  for  base-to*depot  transportation  and  handling  and 
DNUS  contractual  repair  the  variable  acronym  changes  to  ORCTC,  and  fer  overseas  contractual  repair  It  changes  to  ORCTC. 

Dn  flight-line  support  equipment  per  base  required  for  tne  system. 

[pair  of  lower  level  assemblies  expressed  as  a fraction  of  FLU  unit  cost.  This  amounts  to  Implicit  costs  for  labor,  material  and  stockaqe  of  lower 
nd  veri  ficatlon . 

;ed  to  repair  failed  FLU's  at  the  depot.  The  cost  Is  expressed  as  a fraction  of  FLU  unit  cost.  This 
iwneots  within  the  FLU,  components  such  as  SRU's. 

ir  the  first  tune  when  the  system  Is  deployed. 

ODEL  INPUT  DATA  VARIABLES  AT  TWO-DIGIT  AND  FIVE-DIGIT  WORK  UNIT 
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c . Logistics  Composite  Model  (LCOM) 

( 1 ) Overview 

The  LCOM  is  a simulation  model  that  provides  estimates  of 
the  maintenance  manpower  requirements  of  a weapon  system  under 
development.  Currently  it  is  exercised  for  the  DSARC  II  full- 
scale  development  decision.  The  model  simulates  flying  a given 
set  of  aircraft  and  maintaining  these  aircraft.  Its  most  impor- 
tant inputs  include  extensive  data  on  the  aircraft  hardware 
including  avionics  equipment  at  the  FLU  level,  and  the  opera- 
tional scenario  projected  for  the  new  weapon  system. 

( 2 ) Comparability  Analyses 

The  comparability  analyses  that  are  conducted  on  specific 
pieces  of  equipment  are  the  most  important  elements  of  the  LCOM 
approach  applicable  to  the  estimation  of  support  costs  for 
avionics  equipment.  These  analyses  are  conducted  by  engineers 
and  logistics  experts,  whose  qualitative  expert  Judgments  are 
explicitly  brought  into  the  analyses.  In  these  analyses  an 
existing  piece  of  equipment  analogous  to  the  proposed  new  piece 
of  equipment  is  selected,  the  logistics  characteristics  of  the 
analogous  piece  of  equipment  are  identified,  and  then  the  analyst 
adjusts  these  characteristics  to  be  consistent  with  the  predicted 
characteristics  of  the  new  piece  of  equipment.  Usually  this  is 
an  upgrading  of  a logistics  characteristic  such  as  MTBF.  A 
sample  comparability  worksheet  is  provided  in  Appendix  C. 

This  comparability  analyses  approach  is  critical  for  several 
reasons.  First,  it  provides  the  Air  Force  an  opportunity  to 
Introduce  into  its  manpower  estimation  models  some  of  the  same 
kinds  of  expert  engineering  Judgments  included  in  the  engineer- 
ing bottoms-up  cost  estimating  approaches  used  by  commercial 
avionics  equipment  producers.  There  is  wide  general  agreement 
in  the  defense  community  that  engineering  bottoms-up  approaches 
provide  the  most  reliable  cost  estimates,  with  other  things 


such  as  maintenance  concepts,  operating  scenarios,  and  the  like 
held  constant.  If  this  general  agreemnt  about  engineering  cost 
estimates  is  correct,  then  the  comparability  analysis  approach 
of  LOOM  Introduces  this  element  of  accuracy  into  manpower  esti- 
mating at  the  equipment  level  in  the  Air  Force. 

A second  significance  of  the  comparability  approach  is 
that  it  is  possible  to  pursue  it  Internally  within  the  Air 
Force,  thereby  providing  an  independent  engineering  input  into 
Air  Force  manpower  estimates,  independent  of  the  avionics  con- 
tractors . 

The  extensive  data  include  the  construction  of  "task  net- 
works" which  constitute  the  LOOM  model's  primary  data  base. 
These  task  networks  are  sequences  of  maintenance  actions 
resulting  from  sorties,  inspection  requirements,  and  component 
failures.  Real  data  are  structured  from  the  AFM  66-1  mainte- 
nance data  collection  (MDC)  system,  collected  from  the  AFLC 
DO  56  reporting  system  and  the  GO  33B-NWIA  summary  of  aircraft 
sorties  and  flying  hours  from  the  AFM  65-110  reporting  system. 
These  specific  systems  are  discussed  later  in  the  data  systems 
section.  The  result  is  to  take  recorded  maintenance  actions 
on  current  systems  and  to  translate  them  into  maintenance 
frequencies  and  probabilities  per  flight.  These  task  data 
outputs  show  average  elapsed  time,  crew  sizes,  and  mean  sorties 
between  maintenance  actions.  Shop  work  data  also  show  the 
proportions  of  bench  check  okay  and  NRTS . These  data  are  all 
available  for  the  LOOM  by  WUC,  Air  Force  Speciality  Code  (AFSC) 
(work  center),  and  type  of  maintenance  action.  The  data  may 
be  shown  at  the  five-digit  WUC  level,  usually  identified  as 
the  line  replaceable  unit  (LRU)  level.' 


'Major  D.C.  Tetmeyer,  S.R.  Nichols,  R.N.  Deem,  Simulating  Maintenance  Man- 
ning for  New  Weapon  Syeteme:  Maintenance  Data  Analysis  Program,  Wrl^t- 
Patterson  AFB,  Air  Force  Human  Resources  Laboratory,  ASD,  1976. 


The  actual  MDC  data  provide  baselines  for  existing  pieces 
of  equipment  including  avionics  at  the  five-digit  WUC  level. 

The  analyst  then  creates  characteristics  for  new  equipment  on 
a proposed  system  by  "building"  on  the  baseline  system.  The 
most  comparable  piece  of  currently  operational  equipment  is 
selected  as  most  similar  to  the  equipment  placed  on  a new 
proposed  weapon  system.  The  failure  rate  for  the  new  equipment 
is  a decrement  or  an  increment  of  the  real  MDC  data  for  the 
comparable  existing  equipment.  This  determination  is  made  by 
engineering  and  logistics  experts  at  the  Air  Force  Human 
Resources  Laboratory.  These  new  hardware  characteristics  are 
then  fed  into  the  LOOM  model  and  flying  the  aircraft  is  simu- 
lated within  the  environment  of  the  new  maintenance  charac- 
teristics. •'  ' 

It  would  be  possible  to  use  failure  rates  determined  by 
specifications  or  demonstrated  in  reliability  tests  since 
improvement  curves  for  reliability  as  a function  of  testing 
and  correction  are  well  established.  However,  it  is  also  true 
that  field  maintenance  work  occurs  five  to  ten  times  as  fre- 
quently as  the  "true"  failures  demonstrated  on  carefully  built 
prototype  equipment  facing  ideal  test  conditions.  Initial  test- 
ing monitored  through  the  Air  Force  Test  and  Evaluation  Center 
(AFTEC)  does  not  provide  a large  enough  statistical  data  base, 
and  is  further  limited  by  design  changes  and  deficiency  cor- 
rections . 

To  establish  comparability  for  avionics  equipment,  the 
following  characteristics  are  considered  in  selecting  an  exist- 
ing piece  of  equipment  that  is  most  similar  to  the  proposed 
equipment:  function,  parts  count,  operating  power,  complexity, 

interconnects  and  multiplexing,  cooling  and  pressurization, 
vibration,  number  and  type  of  rotating  electro-mechnlcal  com- 
ponents, solid  state  versus  tube,  number  of  connectors  and 
operator  controls,  and  the  number  and  type  of  signals  displayed. 
A sample  comparability  assessment  is  presented  in  Appendix  C. 
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Although  not  used  before  DSARC  II,  the  LOOM  approach  to 
estimating  maintenance  manpower  could  be  exercised  at  any  time 
during  the  acquisition  process.  A weapon  system  could  concep- 
tually be  built  on  paper  using  the  comparability  analyses 
approach  to  maintenance  manpower  estimating. 

d.  MOD-METRIC  Model 

The  MOD-METRIC  spares  inventory  management  model  provides 
a mathematical  optimization  technique  for  determining  optimal 
stock  levels  of  spares.  Specifically,  it  is  designed  to  cal- 
culate the  optimum  mix  of  recoverable  spare  parts  that  can 
be  purchased  with  a specified  budget  while  minimizing  base 
unfilled  demands  (backorders).*  < 

The  model  identifies  the  logistics  relationship  between 
an  assembly  and  its  sub-assemblies.  The  logistics  relationship 
is  defined  by  average  resupply  time  of  the  assembly,  MTBPs  for 
the  assembly  and  its  components , and  the  average  resupply  time 
for  each  of  the  components.  When  processed  to  optimize  spare 
stock  levels  at  the  base  and  depots  levels,  the  model  minimizes 
total  expected  base  backorders  for  a piece  of  aircraft  hardware, 
such  as  a piece  of  avionics  equipment,  subject  to  a spares 
investment  constraint.  By  solving  the  model  for  different 
spares  investment  constraints,  a minimum  expected  base  backorder 
curve,  like  the  curve  in  Figure  7,  can  be  generated  for  different 
quantities  of  dollars  spent  on  spares.  This  curve  can  then  be 
used  to  determine  a level  of  spares  investment  that  will  be 
consistent  with  a certain  spares  optimization  level. 

Each  point  on  a backorder-investment  (BOI)  curve  in 
Figure  7 represerlts  a minimum  backorder  quantity  obtainable 
with  a given  amount  of  spares  investment  dollars.  Thus,  for 
quantity  of  spares  investment  I^,  the  minimum  backorders 

'Recoverable  items  are  sigilflcant  In  that  they  represent  about  two-thirds 
of  the  Air  Force  spares  investment  total. 
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BACKORDERS 


Figure  7.  MOD-METRIC  BACKORDERS  VERSUS  INVESTMENT  CURVE 

obtainable  for  a given  set  of  LRUs  and  SRUs  Is  backorder 
quantity  A.  The  MOD-METRIC  model  uses  the  Investment  amount 
as  a constraint,  and  the  minimum  backorder  quantity  A Is  calcu- 
lated. In  the  process  of  calculating  minimum  backorders  A,  the 
model  also  allocates  the  given  dollars  I^  to  LRU  and  SRU  spares, 
thus  determining  the  optimum  spares  to  buy  given  that  dollar 
total . 

Inputs  to  MOD-METRIC  Include  specific  equipment  charac- 
teristics such  as  frequency  of  removals,  average  resupply  Items, 
NRTS  rates,  and  average  repair  times  at  base  and  depot.  A 
maintenance  concept  and  a repair  level  analysis  must  also  be 
specified  In  the  model. 
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Because  MOD-METRIC  focuses  on  individual  items  of  equip- 
ment including  avionics  at  multiple-digit  WUC  levels,  it  pro- 
vides an  available  technique  for  selecting  spare  costs  given 
a level  of  spares  optimization. 

e.  Optimum  Repair  Level  Analysis  (ORLA)  Model 

ORLA  is  a mathematical  model  used  to  determine  the  least- 
cost  level  of  repair  policy  for  new  equipment  introduced  into 
the  Air  Force  inventory.  ORLA  adds  iip  the  various  costs  of 
each  of  three  maintenance  alternatives  for  a given  LRU:  discard 
at  failure;  repair  at  base;  repair  at  depot.  The  least-cost 
policy  is  determined. 

An  ORLA  model  is  very  complex  and  requires  much  data.  It 
is  not  usally  Implemented  until  after  an  affirmative  DSARC  II 
milestone  decision  is  made. 

f . Avionics  Equipment  Support  Cost  Parametric  Cost 
Estimating  Relationships 

( 1 ) Avionics  Laboratory-Sponsored  Research 

Two  recent  Air  Force  Avionics  Laboratory  (AFAL)-sponsored 
studies  have  produced  avionics  equipment  support  cost  CER's. 
Volume  1 of  the  earlier  study.  Coat  Analysis  of  Avionics  Equip- 
ment (February  1974)j  contains  parametric  annual  maintenance 
cost  equations  for  doppler  radars,  computers,  fire  control 
radars,  and  a general  avionics  equipment  CER.  For  doppler 
radars,  general  equipment,  and  computers,  the  only  Independent 
variables  in  the  equations  are  procurement  costs.  As  an 
example,  the  general  equipment  maintenance  equation  is  LOG 
cost  = -1.62  + 0.86  LOGX^,  where  cost  is  annual  maintenance 
cost  per  unit  and  is  culmulatlve  average  cost  at  1000  units 
of  production. 


The  fire  control  radar  maintenance  equation  uses  peak  power 
In  kilowatts  as  Its  Independent  variable,  and  Is  of  the  specific 
form: 

LOG  cost  = -2.086  + 0.611  LOGX^. 

The  later  AFAL-sponsored  study  CERs  for  Airborne  Array 
Radars,  FLIRs,  and  Avionics  Logistic  Support,  went  a step 
further  and  Included  MTBF  as  a second  Independent  variable 
along  with  procurement  cost.  As  an  example,  the  maintenance 
cost  CER  for  Inertial  measurement  units  (IMUs)  Is 

LOG  C = 5.^32  + 0.02L4  LOGX^  - 0.577  LOGX^, 
where  C Is  annual  maintenance  cost,  X,  Is  IMU  procurement  cost, 

p 

and  Is  MTBF  In  hours.  The  R coefficient  of  determination 
Is  only  .348,  which  Indicates  that  only  a third  of  the  changes 
In  IMU  maintenance  cost  are  explained  by  the  two  Independent 
variables.  Higher  coefficients  of  determination  were  obtained 
for  other  variables,  but  the  wide  variations  In  coefficients 
of  determination  raise  doubts  about  the  usefulness  of  these 
specific  CER's. 

The  key  element  Is,  of  course,  the  data  base  used  to  run 
the  regressions  to  arrive  at  the  coefficients  of  the  Independent 
variables.  In  the  earlier  AFAL  study,  data  from  six  different 
sources  were  used  with  little  assessment  of  data  quality.  In 
the  second  study,  IROS  data  provided  the  dependent  variable 
maintenance  costs  and  AFLC-reported  data  provide  the  MTBF's  for 
each  type  of  equipment  by  AN-number.  The  IROS  data  were  noted 
as  deficient  In  base  material  and  depot  activity  costs,  so  a , 
cost  factor  multiplier  was  determined  that  could  expand  the 
IROS-based  results  to  reflect  total  maintenance  costs.  The 
factor  of  2.17  Is  based  on  a life  cycle  cost  study  of  the  A7D 
aircraft  and  Is  explicitly  qualified  as  only  uncertainly 
applicable  to  other  weapon  systems. 
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These  qualifications  to  the  latest  Avionics  Laboratory 
equipment  level  support  cost  parametric  CERs  highlight  the 
major  stumbling  block  in  developing  avionics  equipment  level 
CERs — reliable  data.  Conceptually  there  is  no  reason  that 
logistic  support  CERs  should  be  difficult  to  develop  for  exist- 
ing avionics  equipment.  However,  the  data  problem  is  not  as 
simple  as  arriving  at  more  and  better  data,  because  this  problem 
is  related  to  another  that  applies  to  the  basic  methodology  used 
in  the  past  to  develop  avionics  equipment  support  cost  CERs. 
Conceptually,  better  data  not  only  means  numbers  that  more  truly 
reflect  the  actual  field  experience  with  avionics  equipment,  it 
also  means  collecting  data  in  meaningful  categories.  To  deter- 
mine what  is  meaningful  requires  knowledge  about  the  key  inde- 
pendent variables  that  Influence  support  costs  before  going  out 
to  gather  the  data.  As  the  earlier  AFAL  study  admits,  regres- 
sions are  frequently  run  to  determine  which  are  the  significant 
varjables  instead  of  the  other  way  around — running  regressions 
to  try  to  disprove  the  hypothesis  that  the  selected  variables 
are  not  the  correct  variables.  Thus,  it  appears  that  because 
of  the  dictates  of  necessity  and  data,  regressions  are  often 
run  first  to  pick  out  key  variables.  But  ascribing  this 
measurement-before-theory  practice  to  necessity  does  not  diminish 
its  weak  conceptual  basis.  Existing  avionics  equipment  support 
cost  CERs  as  represented  by  the  AFAL  studies  in  197^  and  1975 
carry  little  confidence  in  their  calculated  coefficients.  Until 
theoretical  conceptualizations  of  avionics  equipment  cost  drivers 
are  offered  for  empirical  testing,  avionics  support  cost  CERs 
will  be  suspect  at  any  stage  of  the  acquisition  process. 

(2)  CACE  Factors  Model 

The  Air  Force  Cost  Analysis  Cost  Estimating  (CACE)  model 
is  a variation  of  the  regression  approach.  It  uses  cost  factors 
developed  through  regression  analysis  to  estimate  recurring 
investment  and  miscellaneous  logistics  costs  including  base 
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maintenance  material,  depot  maintenance  labor  and  material. 

Class  IV  modifications  and  their  Initial  spares,  and  replenish- 
ment spares.  These  estimates  are  all  at  the  weapon  system  level. 

Key  parameters  of  a proposed  weapon  system  are  multiplied 
times  factors,  some  of  which  are  developed  by  regression  equa- 
tions, to  generate  estimates  for  the  cost  elements  represented 
by  the  factors.  The  regression-developed  factors  are  frequently 
functions  of  the  new  proposed  weapon  system's  acquisition  cost 
and  physical  characteristics.  As  an  example,  replenishment 
spares  cost  per  flying  hour  (RS$/FH)  could  be  the  dependent 
variable  In  a regression  equation  where  the  Independent  variables 
are  avionics  production  cost,  engineer  production  cost,  airframe 
production  cost,  maximum  aircraft  speed,  and  aircraft  empty 
weight.*  The  form  of  the  functional  relationship  may  vary, 
but  the  reliance  on  historical  data  regressed  against  aircraft 
cost  and  physical  data  remains. 

The  CACE-type  model  Is  the  standard  Air  Force  format  within 
which  operating  and  support  costs  estimates  are  prepared  for 
DSARC  submission,  but  It  does  not  provide  a component  estimate 
capability. * 

4.  DATA  AND  MANAGEMENT  INFORMATION  SYSTEMS 
a.  Overview 

The  key  Air  Force  data  and  management  systems  that  provide 
support  cost  data  to  the  various  models  and  techniques  described 
In  the  previous  sections  are  discussed  below.  Their  basic 
outlines  are  offered  as  Indications  of  what  Is  available.  No 

‘This  Is  baslcadly  the  approach  taken  by  the  Navy  for  total  aircraft  support 
cost  estimates.  The  equations  used  In  the  F-l8  top  level  model  dlsciissed 
later  In  this  chapter  resent le  the  CAGE  factor  regresslcMi  equations. 

‘The  Navy  takes  Independently  developed  total  weapons  system  equations 
similar  to  the  CAGE  equatlcxis  and  extends  them  to  the  F-l8  NAVAIR  sub- 
system tacking  model  discussed  later  In  part  C. 
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attempt  to  provide  detailed  expositions  of  the  data  systems  is 
intended. 

b . Operating  and  Support  Cost  Estimating  Reference 
(OSCgR) 

OSCER  is  a management  information  system  that  responds  to 
part  of  the  SECDEP  requirements  for  a Visibility  and  Management 
of  Support  Costs  (VAMOSC)  system.  Specifically,  OSCER  organizes 
data  inputs  form  fourteen  existing  data  systems  into  the  opera- 
ting and  support  cost  elements  and  sub-elements  shown  in  Table  3 
for  MDS  aircrat.  It  does  not  report  support  costs  at  the 
individual  component  level.  The  cost  accounts  into  which  data 
are  reported  and  subsequently  organized  into  the  cost  elements 
in  Table  3 are  displayed  in  Appendix  D. 

The  reported  costs  are  distributed  to  weapon  system  MDS 
either  by  allocation  or  estimation.  Some  of  the  cost  element 
data  are  based  on  direct  input  accounting  systems,  including 
the  data  for  unit  operations,  below  depot  maintenance,  base 
installation  support,  second  destination  transportation,  and 
depot  installation  support.  These  data  are  then  allocated  to 
MDS.  Depot  maintenance  data  are  input  through  the  depot  mainte- 
nance industrial  fund  accounting  and  production  reporting  system 
(HO  36),  but  this  accounting  system  utilizes  standard  rather 
than  actual  costs  and  common  item  maintenance  costs  are 
allocated  to  weapon  systems.  As  a result,  depot  maintenance 
data  are  more  accurately  identified  as  "factors"  than  as  direct 
accounting  inputs.  Other  cost  elements  and  sub-elements  that 
are  factored  Include  POL,  replenishment  spares,  training  muni- 
tions, personnel  training,  PCS,  and  medical.  Thus,  for  the 
OiS  costs  (for  PY  76)  reported  in  OSCER  for  a modern  fighter 
aircraft  like  the  F-15A,  the  direct  accounting  data  cost  elements 
accounted  for  59?  of  the  total  reported  costs,  and  the  factored 
data  cost  elements,  including  depot  maintenance,  accounted  for 
4lJ  of  the  total  reported  costs.  Similar  proportions  for  other 
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Table  3.  OSCER  COST  ELEMENTS  AND  SUB-ELEMENTS 


Cost  Element 

Sub- El emen ts 

1 

UNIT  OPERATIONS 

(Identified  under  the 
mission  program  ele- 
ment in  the  major  force 
program  structure) 

Aircrew 

Command 

Securi ty 

POL 

BELOW  DEPOT  MAINTENANCE 

(Identified  under  the 
' mission  program  ele- 
ment in  the  major  force 
program  structure) 

Chief  of  Maintenance 

Avionics 

Consol i dated 

Field 

Munitions  Airborne  Missile 
Organizational 

i SUSTAINING  INVESTMENT 
( I denti f ied  under  the 
mission  program  ele- 
ment in  the  major  force 
program  structure) 

Replenishment  Spares  Replacement 
MOD  Kits/Material 

Ground  Support  Equipment 

Training  Airborne  Missile 

Training  Munitions 

INSTALLATION  SUPPORT  (BASE) 

(Identified  under  the 
support  program  element 
in  the  major  force  pro- 
gram structure) 

Real  Property  Maintenance 

Common i ca  ti ons 

Base  Operations 

ADVANCED  TRAINING  (Flying 
Status) 

Officer 

Enl i sted 

(Identified  under  the 
support  program  element 
in  the  major  force  pro- 
gram structure) 

. 

DEPOT  MAINTENANCE 

(Major  force  program  7) 

PDM/MOD 

Engi nes 

Av i ones 

Other 

DEPOT  SUPPLY  ACTIVITIES 
(Major  force  program  7) 

Distribution 

Materiel  Management 

Procurement 

Technical  Support 

SECOND  DESTINATION  TRANS- 
PORTATION 

(Major  force  program  7) 

INSTALLATION  SUPPORT  (DEPOT) 
(Major  force  program  7) 

Real  Property  Maintenance 

Communi cations 

Base  Operations 

ADVANCED  TRAINING 

(Major  force  program  8) 

Officer 

Enlisted 

HEALTH  CARE 

(Major  force  program  8) 

PERMANENT  CHANGE  OF  STATION 

(Major  force  program  8) 

INSTALLATION  SUPPORT 
(Major  force  program  8) 

Real  Property  Management 

Communi cations 

Base  Operations 

u ; 


MDS  aircraft  O&S  costs  in  the  PY  76  OSCER  report  support  the 
conclusion  that  more  than  half  of  the  O&S  costs  in  OSCER  are 
based  on  accounting  data  allocated  to  MDS  (not  directly  reported 
to  MDS),  and  the  remaining  O&S  costs  are  factored. 

The  allocation  methodologies  for  depot  and  base  maintenance 
are  too  complex  to  pursue  here,  but  the  replenishment  spares 
methodology  Is  relatively  straight-forward  and  permits  us  to 
examine  a detailed  OSCER  factoring  approach.  For  a given  MDS, 
the  cost  of  replenishment  spares  (R^)  is  given  by  the  equation 

D _ Depot  Maintenance  Repair  Cost 

^i  ■ r.wnCrmy  • 

The  numerical  constants  in  the  equation  are  derived  as  follows. 
For  a given  fiscal  year,  the  depot  maintenance  costs  associated 
with  all  work  breakdown  structure  groups  (excluding  programmed 
depot  maintenance  and  engine  repairs)  averaged  14.5/5  of  the 
inventory  value  of  NRTS  items.  Also  for  a given  fiscal  year, 

3%  of  NRTS  items  (C)  resulted  in  depot  condemnations  (and  97% 
were  repaired).  If  X is  the  value  of  the  NRTS  inventory,  then 
depot  maintenance  repair  cost  (D)  is  given  by 

(.97)(.145)X  = D. 

Rearranging  the  equation,  X,  the  value  of  the  NRTS  Inventory  is 


Since  3%  of  the  items  are  condemnations  and  are  to  be  replaced 
with  replenishment  spares  funds,  the  OSCER  approach  is  to 
multiply  the  condemenation  percentage  times  the  value  of  the 
total  NRTS  Inventory,  as  shown  in  the  equation  below: 

R = CX 
R = .03X  . 

This  provides  an  aggregate  estimate  of  replenishment  spares 
costs  for  the  entire  Air  Force.  But  to  use  the  equation  at 
the  MDS  level,  it  would  be  necessary  to  know  the  NRTS  Inventory 
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value  by  MDS,  and  these  data  are  not  available  in  any  existing 
reporting  system.  However,  because  the  Inventory  value  of 
NRTS  items  is  equal  to  depot  maintenance  repair  cost  (D)  divided 
by  the  two  numerical  constants  (.97  and  .145),  and  because  depot 
maintenance  repair  cost  data  are  available  by  MDS  in  the  Depot 
Maintenance  Industrial  Fund  Accoui^ting  and  Production  Reporting 
System  (HO  36),*  replenishment  spares  costs  by  MDS  can  be  cal- 
culated by  transforming  the  simple  equation  from  condemnation 


rate  times 

Inventory  value  to  condemnation  rate  times  what 

Inventory 

value  by  MDS 

is  equal  to.  Thus, 

«1 

= .03X^  , 

then  if 

= Di 

i 

(.97TT7rT5T  ’ 

^i 

= .03  Di 

{.97)(.145)  ’ 

and 

^i 

= .2133  D^  , 

where 

Ri 

= replenishment  spares  by  MDS, 

^i 

= NRTS  Inventory  value  by  MDS, 

.03 

= condemnation  rate  percentage  of  NRTS 
items , 

.97 

= NRTS  items  repaired  at  depot. 

.145 

= total  depot  maintenance  cost  as 
percentage  of  total  NRTS  inventory 
value , 

.2133 

= numerical  factors  combined  and 
simplified. 

d, 

= depot  maintenance  repair  cost  by  MDS. 

Thus,  the  OSCER  equation  allocates  replenishment  spares  to  MDS 
on  the  basis  of  depot  maintenance  repair  costs  by  MDS  as  the 
weighting  factor  (and  combined  with  the  numerical  values 
identified  above). 


‘Conmon  items  are  prorated  to  weapon  systems  in  the  data  system. 


The  OSCER  cost  equations  are  characterized  by  factors  and 
allocations  like  those  in  the  replenishment  spares  equation. 

Even  if  OSCER  were  designed  to  provide  costs  by  equipment  levels 
such  as  two-  or  five-digit  WUCs,  which  it  is  not,  it  is  doubted 
that  the  equations  would  provide  useful  results.  Similar 
criticisms  apply  to  the  Navy's  weapon  system  level  VAMOSC 
report,  but  not  to  its  maintenance  subsystem  report  .which  uses 
direct  data  inputs  by  seven  digit  WUC  to  build  its  maintenance 
and  replenishment  spares  cost  reports . 

The  Air  Force  is  currently  constructing  an  equipment  level 
LRU  and  SRU  maintenance  data  VAMOSC  reporting  system  separate 
from  the  OSCER  effort.  This  equipment  level  system  has  not 
yet  produced  a published  report. 

c . Increase  Reliability  of  Operational  Systems  (IROS) 

The  IROS  program  identifies  equipments  that  are  high  con- 
sumers of  logistic  support  cost.  As  of  March  1,  1977,  this  is 
being  done  for  thirty-seven  aircraft,  ten  aircraft  engines, 
two  missiles,  ninety-one  communications-electronics-metrologl- 
cal  equipments,  and  sixteen  munitions  handling  equipments.^ 

The  identification  and  ranking  of  equipment  high  cost  consumers 
is  at  the  five-digit  WUC  level  of  detail.  The  data  are  accumu- 
lated quarterly  in  the  KO  51  data  system,  with  substantial  data 
collected  on  a dally  basis  in  the  AFM  66-1  equipment  status 
reporting  system,  and  several  Depot  Level  Repair  Management 
Systems.  The  costs  reported  into  IROS  include  base  labor, 
depot  labor,  depot  materials,  cost  of  condemnations,  transporta- 
tion, and  packaging-shipping  costs.  IROS  data  exclusions 


*A  1975  RAND  Report,  R-1569-PR,  An  Appraisal  of  Logistics  Support  Costs 
Used  in  the  Air  Force  IROS  Program,  by  M.  Florello  and  P.K.  Day  suggests 
that  the  IROS  reports  could  be  made  more  useful  by  capturing  the  costs 
for  which  they  are  deslgied,  including  base  material,  planned  depot  mainte- 
nance, and  engine  repair,  and  by  extending  coverage  to  include  base  and 
depot  AGE  maintenance,  pipeline  spares,  modification  hardware,  and  others. 
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include  some  elements  of  base  material,  planned  depot  mainte- 
nance, and  engine  repair.  A January  197^  IROS  briefing  package 
suggests  that  "...extreme  difficulty  is  being  experienced  in 
accumulating  parts  costs  at  base  and  intermediate  levels,"  and 
advises  that  IROS  costs  do  not  Include  the  cost  of  field  level 
parts  replaced. ^ In  addition,  the  IROS  briefing  warns  that 
there  are  many  depot  level  activities  not  related  to  a WUC  so 
the  costs  shown  in  IROS  are  lower  than  actual  costs  experienced 
during  programmed  depot  maintenance.^  Thus,  IROS  accumulates 
only  some  of  the  data  elements  relevant  to  the  support  costs 
of  maintenance  at  all  levels  and  spares  and  repair  parts  support. 

The  AFLC  data  systems  that  provide  inputs  to  IROS  include: 

DO  ^3  Cataloging  Data 

DO  33  Aerospace  Vehicle  Inventory  and  Equipment 

Status  Report 

DO  56  Product  Performance  System 

DO  24l  Engine  Configuration  System 

DI  43  Management  Division  and  Technical 

Identification 

GO  11  TIRES 

GO  8l  Lockheed  C-5A  MADARS/Ground  Processing  System 

GO  26  Material  Improvement  Program. 

Given  the  coverage  and  exclusions  of  IROS  data,  it  is 
possible  to  extract  some  logistic  support  costs  from  IROS  for 
the  five-digit  WUCs  on  a given  aircraft.  A sample  summary  IROS 
support  cost  ranking  of  five-digit  WUCs  on  a given  MDS  is  dis- 
played in  Table  4.  These  and  similar  rankings  of  relatively 
high  support  cost  equipments  are  the  intended  outputs  of  IROS. 

As  an  example,  WUC  23BAE  in  Table  4 is  the  twenty-sixth  highest 
ranking  support  cost  consumer  among  the  equipments  on  a given 


^IROSy  Air  Force  Logistics  Ccxtinand,  January  1974. 

^IROS  weapon  system  and  equipment  coverage  is  given  in  Appendix  F. 
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MDS  in  the  current  quarter  reported.  Logistic  support  costs 
by  IROS  categories  are  also  available  as  IROS  outputs  as  shown 

f 

in  Table  5. 

d.  DO  56B  - Maintenance  Actions,  Manhours,  and  Aborts 

by  Win: 

This  report  provides  on-  and  off-equipment  historical 
information  on  maintenance  actions,  manhours,  and  aborts  for 
the  past  six  months  on  every  WUC  included  in  a master  record. 

DO  56B  also  serves  as  an  historical  record  for  each  WUC,  and 
as  such  provides  the  tracking  capability  for  plotting  trends 
in  failures,  maintenance  actions,  manpower  resource  expenditures, 
and  aborts.  The  primary  use  of  th'e  system  is  for  reliability 
and  maintainability  studies  and  for  verification  of  modification 
effectiveness . 

The  MTBF  is  computed  each  month  on  all  WUCs  unless  there 
are  no  reprorted  failures  for  any  three  consecutive  months 
within  the  time  span  covered  by  the  report . For  each  monthly 
MTBF  computation,  a three-month  accumulation  of  failures  and 
operating  time  (flying  hours  or  days)  is  used.  The  MTBF  formula 
is  as  follows: 

„mpp  _ (OPT)(UF)(QPA)  ( SI  \ 

- FO ’ 

where : 

OPT  = operating  time,  a three-month  accumulation  of 
flying  hours  or  days 

UF  = use  factor,  a ratio  of  item  operating  time  to 
flying  hours,  usually  = 1 

QPA  = number  of  identical  items  reported  under  one  WUC 

FO  = three  month  accumulated  failure  occurrences 

SI  = special  inventory,  applies  when  the  inventory  of 

a WUC  applies  to  only  a part  of  the  fleet 

AFM-1  * computed  inventory;  the  data  in  Standard  Aerospace 
Vehicle  and  Equipment  Status  Reports  are  used  to 
compute  inventory  for  aircraft  and  other  weapons. 
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Table  5.  SAMPLE  LOGISTIC  SUPPORT  COST  BREAKDOWN  FOR  MDS  A007D 
CURRENT  QUARTER  COMPUTATION  DATA  AS  OF  AUGUST  1973 
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Mean  time  between  maintenance  actions  (MTBMA)  is  computed 
for  each  month  for  each  WUC  using  the  same  formula  as  for  MTBF 
above,  except  that  the  FO  (failure  occurrences)  term  is  replaced 
by  TO,  total  maintenance  action  occurrences. 

The  DO  56  system  permits  a six-month  total  for  each  WUC  to 
be  the  output  for: 

(1)  operating  time 

(2)  aborts  or  mission  failures 

(3)  failure,  other  malfunctions,  and  total  occurrences 

(4)  six  months  MTBF 

(5)  six  months  MTBMA 

(6)  scheduled,  unscheduled,  and  shop  manhours 

(7)  repaired,  condemned,  and  NRTS  items  listed. 

e . GO  33  - Aerospace  Vehicle  Inventory.  Status  and 
Utilization  Reporting  System  (AVISURS) 

Statistics  relative  to  flying  hours,  landings,  and  sorties 
accomplished  by  an  aerospace  vehicle  during  the  report  month 
are  reported  in  this  data  system.  The  system  applies  to  air- 
craft, selected  missiles,  communlcations-electronics-meterolo- 
glcal  equipment,  and  trainers. 

The  data  are  used  in  conjunction  with  the  DO  56  data  to 
compute  MTBFs  and  to  provide  NORS  data  for  evaluating  mainte- 
nance and  supply  effectiveness. 

The  data  flow  is  from  the  GO  33A  system  at  the  base  to  the 
GO  33c  system  at  major  command  to  the  the  GO  33B  system  at  AFLC 
headquarters.  The  systems  are  managed  in  accordance  with 
AFR-65-IIO.  Information  derived  from  GO  33  statistics  is  used 
by  logistics  management  to  establish  requirements  pertaining  to 
the  general  support  of  aerospace  vehicles.  In  addition,  the 
flying  hours  reported  are  used  to  update  the  Accumulated  Life 
Cycle  Airframe  Hours  for  each  aerospace  vehicle,  identified  by 
serial  number,  in  the  Aerospace  Vehicle  Master  Inventory.  Each 
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Air  Force  Activity  possessing  Aerospace  Vehicles  is  required 
to  report  flying  hours,  landings  and  sorties  by  mission  symbol 
on  an  as-occurs  basis. 

The  Utilization  Subsystem  supports  the  monthly  and  quar- 
terly data.  This  subsystem  is  processed  monthly,  with  additional 
outputs  on  a quarterly  basis.  Data  are  received  from  each  major 
command  and  each  base  possessing  aerospace  vehicles.  All  major 
commands  possessing  aerospace  vehicles  submit  a monthly  summary 
of  flying  hours,  landings  and  sorties  for  each  mission  accom- 
plished, denoted  by  mission  symbols. 

f . GO  78C  - Inertial  Navigation  Systems  (INS)  Data 
Sys  tern 

The  GO  78c  Data  System' provides  a complete  record  of  test, 
removal,  and  repair  data  for  each  identified  Inertial  Measure- 
ment Unlt/Inertial  Reference  Unit  (IMU/IRU)  and  its  components. 
The  data  that  are  recorded  for  GO  78C  contain  information  con- 
cerning failures  identified  during  test  and  repair  actions. 

When  an  IMU/IRU  or  Not  Repairable  This  Station  (NRTS) 
component  is  sent  to  a depot,  identification,  failure,  repair 
data  and  elapsed  time  readings  are  recorded.  This  becomes  the 
primary  source  of  data  for  the  GO  780  system  and  all  data  are 
retained  in  the  main  data  bank  for  25  months.  In  order  to 
retrieve  data  for  a longer  period  of  time,  special  programming 
efforts  are  necessary.  Such  data  permit  a comprehensive  data 
base  for  engineering  analysis  of  inertial  navigation  systems. 

The  GO  78c  products  are  divided  into  three  basic  groups. 

The  first  group  of  products  contains  test,  failures  arid  repair 
histories  applicable  to  serialized  assemblies  and  components. 

The  second  group  of  products  contains  population  data  which 
depict  summary  information  applicable  to  an  IMU/IRU,  a com- 
ponent, or  parts  removed  from  a component.  Third,  a management 
report  contains  12  months  of  data  recorded  for  a particular 
part  numbered  IMU/IRU. 
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g.  DO  57F  - Failure  Program 


The  Actuarial  Analysis  Program  is  a unique  system  correlat- 
ing usage  and  failure  data  for  analyzing  equipment  reliability, 
developing  actuarial  life  expectancy  factors,  and  forecasting 
failures.  It  has  been  successfully  applied  to  propulsion  systems, 
aircraft  propellers,  certain  helicopter  components,  and  is  now 
being  applied  to  other  selected  air  vehicle  components.  The 
method  or  technique  is  applicable  to  any  item  that  shows  a 
relationship  between  usage  and  aging  of  the  item,  regardless 
of  the  type  of  time  in  which  that  usage  is  measured. 

The  Air  Force  actuarial  method  consists  of  the  development 
and  use  of  actuarial  mathematics,  studies  in  life  contingencies, 
and  the  theory  of  probability,  primarily  for  accomplishing 
forecasts  of  materiel  failures  and  for  the  analysis  of  problems 
related  to  materiel  failures. 

The  Air  Force  requires  dependable  forecasts  of  material 
failures  to  support  planning  for 

(1)  repair  facilities 

(2)  spares  procurement 

(3)  overhaul  schedules 

(4)  budget  requests 

(5)  manpower  and  skills. 

The  Air  Force  Actuarial  Program  is  based  on  the  theory 
that  items  fail  at  various  rates  at  successive  ages.  Age  can 
refer  to  a variety  of  time  measures.  Including  starts,  stops, 
landings,  cycles,  rounds,  operating  time,  and  cumulative 
calendar  or  clock  time.  The  identification  of  failure  patterns 
is  a crucial  step  in  problem  solution,  and  continuous  tracking 
of  the  failure  pattern  and  rate  is  necessary  to  identify  changes 
in  item  performance  resulting  from  aging  or  the  quality  of 
overhauls . 
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A failure  is  defined  as  a condition  requiring  item  removal 
either  because  of  inadequate  performance  requiring  field  mainte- 
nance repair  or  inadequate  performance  requiring  depot  mainte- 
nance action.  Failures  are  the  basis  for  mean  time  between 
failure  (MTBF)  measures,  which  amount  to  the  total  flying 
(operating)  hours  for  a time  period  divided  by  the  failures 
for  the  period. 

The  DO  57F  system  Increases  visibility  of  time  and  failure 
information  for  the  development  of  actuarial  reports  and  factors. 
The  system  can  produce  actuarial  reports  on  any  item  selected 
by  identifying  the  individual  National  Item  Identification 
Number.  Within  a weapon  system,  the  decision  must  be  made  as 
to  which  equipments  will  benefit  from  actuarial  tracking.  Those 
items  that  are  expected  to  fail  as  a function  of  age,  move  as 
a unit  through  the  repair  cycle,  or  are  items  that  require  pre- 
cise forecasts  for  spare  buying  or  overhaul  planning  are  all 
prime  candidates.  High  cost  nonrecovercble  items  are  also 
included  in  DO  57F  coverage. 

h . HO  36  - Depot  Maintenance  Cost  Accounting  Production 
Report 

The  HO  36  depot  maintenance  industrial  fund  (DMIF)  cost 
accounting  production  report  provides  for  the  accumulation, 
recording,  and  reporting  of  all  cost  and  production  data  related 
to  depot  maintenance.  These  data  include  civilian  and  military 
labor,  direct  materials  cost,  and  contractor  maintenance  services. 

The  data  are  accumulated  from  two  ma.ior  depot  maintenance 
data  systems:  (1)  the  GO  72A  depot  maintenance  production  cost 
system,  and  (2)  the  GO  72B  depot  maintenance  production  cost 
system  for  inertial  guidance  systems.  These  two  data  systems 
are  summary  systems  that  receive  input  data  from  more  than 
twenty  other  systems.  Including: 

(1)  Maintenance  End  Item  Reporting  GO  04L 
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(2)  Maintenance  Labor  Distribution  System,  GO  37C 

(3)  Maintenance  Actual  Material  Cost,  GO  04H 

(4)  Contract  Depot  Maintenance  Production  and  Cost 
System,  GO  72D 

(5)  AFLC  Retail  Stock  Control  and  Distribution  and 
Central  Material  Locator  System,  DO  33 

(6)  Work  Measurement  and  Labor  Control  System,  CO  04B 

(7)  Maintenance  Management  Data  System,  GO  35A. 

These  seven  systems  are  themselves  quite  complex,  and  a complete 
detailed  examination  of  their  contents,  as  well  as  the  other 
input  systems  to  HO  36,  is  beyond  the  scope  of  this  paper. 

5 . Summary 

This  section  examined  the  Air  Force  methodological  approaches 
to  estimating  avionics  support  costs  for  fighter  aircraft.  The 
most  frequently  used  component  level  model  is  the  AFLC  LSC  model, 
usually  for  source  selection  and  DSARC  II.  Its  level  of  detail 
is  substantial  in  that  it  goes  to  the  FLU  level  of  equipment 
and  provides  support  cost  estimates  in  several  categories  includ- 
ing field  and  depot  maintenance  and  initial  and  replenishment 
spares . 

Regression  models  developed  by  the  Air  Force  are  either  not 
based  on  broad  enough  support  cost  data  bases  (the  Avionics 
Laboratory  funded  studies  to  date)  or  are  not  used  for  component 
level  cost  estimates  (CACE). 

Models  like  the  LCOM,  MOD-METRIC,  and  ORLA  could  be  utilized 
early  into  the  estimating  sequence  of  the  acquisition  cycle  at 
DSARC  0 or  I,  but  require  substantial  analogy  detail  and  engi- 
neering Judgments  to  be  applied  in  these  early  acquisition  cycle 
phases.  The  LSC  model  could  also  be  utilized  early  in  the 
acquisition  cycle  through  the  use  of  analogy  data  inputs. 

Air  Force  data  systems  provide  considerable  component  sup- 
port cost  detail,  but  not  in  a single  integrated  data  management 
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reporting  system.  The  OSCER  VAMOSC  system  could  potentially 
provide  this  service,  but  currently  does  not  extend  to  the  com- 
ponent level. 

C.  NAVY  METHODOLOGIES,  POLICIES,  AND  DATA  SYSTEMS 
1 . Introduction 

Support  costs*  for  avionics  equipment  on  fighter  aircraft 
are  not  routinely  estimated  by  the  Navy  until  after  the  full- 
scale  engineering  development  decision  milestone  (DSARC  II) 
in  the  major  weapon  system  acquisition  process.  We  believe 
that  although  avionics  equipment-level  support  cost  estimates 
are  first  produced  relatively  late  in  the  acquisition  process, 
the  capability  to  produce  them  earlier  does  exist  in  the  form 
of  appropriate  Navy  methodologies  and  specific  cost  estimating 
models  discussed  in  this  paper. 

The  earlier  discussion  of  Air  Force  support  cost  estimating 
methodology  stressed  the  temporal  flexibility  of  Air  Force  cost 
estimating  techniques.  The  same  stress  is  placed  here  on  the 
flexible  applicability  of  Navy  techniques  with  regard  to  when 
they  are  applied  in  the  major  weapon  system  acquisition  process. 
Critical  assumptions  about  the  data  used  in  these  specific  cost 
estimating  methodologies  are  discussed  later.  The  argument  is 
that  .nost  of  the  necessary  data  inputs  exist  before,  during, 
and  after  any  given  milestone  in  the  acquisition  cycle,  so  that 
the  application  of  a specific  cost  estimating  technique  is 
largely  a matter  of  policy,  not  a matter  of  data  or  estimating 
technique  availability. 

The  current  Navy  fighter  aircraft  development  project  is 
the  F-l8.  This  specific  case  offers  a current  example  of 

*Siipport' costs  refer  to  msilntenance  at  all  levels,  spares,  and  repair  parts 
support.  This  is  a narrower  definition  than  "operating  and  support"  costs, 
such  as  that  offered  in  Noiman  E.  Betague,  Jr.  and  Marco  R.  FLorello, 
Aivcraft  System  Operating  and  Support  Cost:  Guidelinee  for  Analyeie, 
Logistics  Management  Institute,  Washington,  D.C.,  March  1977. 
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avionics  equipment  support  cost  estimating.  Prior  to  DSARC  II, 
avionics  is  treated  at  a highly  aggregated  level  in  total  wea- 
pon system  operating  and  support  (O&S)  cost  equations  that 
contain  avionics  acquisition  cost  estimates  as  independent 
variables.  Once  DSARC  II  is  completed,  NAVAIR  implements  an  O&S 
baseline  tracking  model.  This  baseline  O&S  model  permits  the 
Project  Manager,  Air  (PMA)  to  track  support  cost  trends  at  the 
two-digit  work  unit  code  level.  This  internal  NAVAIR  O&S  model 
is  separate  from  the  O&S  subsystem  model  operated  by  the  prime 
contractor  following  DSARC  II,  which  is  a level  of  repair  (LOR) 
analysis-based  model.  In  addition  to  these  models  used  for 
the  F-l8  program,  the  Navy  has  a Life  Cycle  Cost  model  similar 
in  structure  to  the  Air  Force  LSC  model,  the  CASEE  aircraft 
maintenance  simulation  model,'  and  spares  optimization  models. 

2 . Policies  and  Procedures 

Navy  policies  and  procedures  for  estimating  avionics  sup- 
port costs  on  fighter  aircraft  are  included  under  the  umbrella 
of  the  general  cost  estimating  policies  and  procedures  that 
the  Navy  has  established  to  comply  with  DoD  regulations.^ 

As  discussed  in  the  Air  Force  section  of  this  chapter,  if 
the  mission  need  for  a new  Service  system  acquisition  is  identi- 
fied as  a major  cost  saving  advantage  over  an  existing  system, 
at  DSARC  0,  it  is  possible  that  cost  estimates  even  at  DSARC  0 
milestone  could  be  required.  Whether  cost  estimates  would  be 
at  the  two-digit  WUC  level  or  lower  would  depend  on  the  specific 
mission  need  and  upon  the  source  of  the  cost-saving  opportunity. 


f 'CASEE  is  the  Carrier  Aircraft  Support  Effectiveness  Model,  discussed  in 

I greater  detail  later. 

^Ihe  key  Navy  policies  are  contained  in  SECNAVINST  5000.1,  System  Acquisi- 
tion in  the  Department  of  the  Navy,  OPNAVTNST  5000. ^2A,  Weapon  Systems 
1 Selection  and  Planning,  and  OPNAVINST  5000.^6,  Decision  Coordinating 

i Papers  (DCPs) , Program  Memoranda  (PMs) , and  Navy  Decision  Coordinating 

|’  Papers  ( NDCPs ) . 
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Barring  such  a situation.  Navy  policy  is  to  first  estimate 
support  costs  at  a highly  aggregated  level  for  DSARC  I,  perhaps 
showing  separately  for  the  aircraft,  estimates  for  airframe, 
propulsion,  and  avionics  and  providing  lump-sum  support  cost 
estimates  for  each  of  these  systems. 

For  the  validation  phase  (DSARC  I)  the  system-level  cost 
estimates  are  developed  through  parametric  regression  equations 
derived  from  Naval  Air  Development  Center  (NADC)  research  in 
the  late  1960s. ^ If  alternatives  are  provided  at  DSARC  I, 
costs  are  estimated  for  all  alternatives  using  the  same  model. 

A preliminary  Weapon  System  Planning  Document  (WSPD)  identifies 
procurement  size,  potential  base  loading,  carrier  outflttlngs, 
trainer  requirements  and  depot  capabilities.  'A  comparison  sys- 
tem from  the  current  active  inventory  of  fighter  aircraft  is 
selected  as  the  best  analogy  to  the  proposed  aircraft,  and 
judgments  are  made  about  anticipated  differences  in  size,  com- 
plexity, and  operational  environment  between  this  analogy  com- 
parison system  and  the  proposed  systems. 

During  the  period  of  time  leading  to  the  full-scale 
development  milestone  decision  (DSARC  II),  the  potential  systems 
are  well-defined,  although  not  necessarily  designed.  The  WSPD 
has  been  developed  and  promulgated  to  interested  contractors, 
and  the  source  selection  is  made.  The  source  selection  is  not 
made  based  on  avionics  equipment-level  support  cost  estimates. 
These  estimates  are  only  at  the  total  weapon  system-level  of 
the  aircraft. 

Interim  support  spares  and  repair  parts  cost  estimates 
are  made  based  on  flying  hour  cost.  The  cost  per  hour  is  esti- 
mated considering  the  costs  of  past  systems  and  contractor 
proposals . 


'S.  Getz,  Techniques  for  Estimating  Logistics  Support  and  Operations  Cost 
of  Naval  Airborne  Weapon  Systems  (U) , Report  No.  NADC-SD-1925 , Naval  Air 
Development  Center,  Warminster,  PA,  April  30,  1969. 
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These  basic  policies  and  procedures  are  implemented  through 
specific  models  and  methodologies  for  cost  estimating,  which  we 
examine  in  the  next  section. 

3.  Cost  Estimating  Methods 

a . The  F-18  Total  System  Model 

(1)  Basic  Form  and  Uses 

The  Navy's  DSARC  II  F-l8  cost  presentation  was  based  on 
the  outputs  from  an  eight  equation  cost  model  that  generated 
O&S  costs  for  the  entire  aircraft,  but  not  for  specific  pieces 
of  equipment,  including  avionics.  The  eight  dependent  variables 
estimated  by  the  equations  are: 

(1)  Enlisted  maintenance  and  operating  personnel  per 
squadron , 

(2)  Enlisted  administrative  support  personnel  per 
squadron, 

(3)  Airframe  rework  cost, 

(4)  Engine  rework  cost, 

(5)  Component  rework  cost, 

(6)  Replenishment  spares  costs, 

(7)  POL  cost, 

(8)  Other  consumables  cost. 

The  equations  for  airframe  rework,  component  rework,  replenish- 
ment spares  and  other  consumables  are  regression  equations.  The 
other  costs  are  estimated  by  simple  algebraic  relationships. 

Besides  proving  the  absolute  dollar  values  for  O&S  costs 
submitted  at  the  DSARC  II  milestone,  this  total  system  model 
is  used  to  track  these  costs  throughout  the  full  scale  develop- 
ment program  and  well  into  the  production  program.  It  was 
disaggregated  following  DSARC  II  into  a baseline  subsystem  cost 
tracking  model  operated  by  NAVAIR  and  discussed  later  in  this 
paper.  Because  these  costs  are  disaggregated  to  the  two-digit 
WUC  level  in  the  baseline  tracking  model,  it  is  appropriate  to 


carefully  examine  the  total  system  model  equations  in  the  next 
section. 

The  eight  cost  variables  listed  above  are  described  by 
NAVAIR  and  McDonnell  Douglas  Aircraft  Corporation  (MCAIR,  the 
F-l8  prime  contractor)  as  representing  the  direct  O&S  costs 
for  the  F-l8  as  they  will  accumulate  over  time,  per  the  Weapon 
System  Planning  Document  (WSPD).  The  total  system  cost  model 
equations  are  designed  to  reflect  the  influence  of  F-l8  design 
parameters  on  total  O&S  costs.  The  costs  (dependent  variables) 
were  selected  fro*ln  the  direct  costs  listed  in  the  Navy  Resources 
Model  (NARM),'  except  for  the  personnel  costs  which  include 
direct  and  indirect  costs. 

The  NARM  costs  are  the  values  for  categories  such  as  com- 
ponent rework,  engine  rework,  and  airframe  rework,  for  several 
aircraft.  These  values  are  inputs  to  the  regression  model  and 
are  used  as  the  dependent  variables  to  be  regressed  against 
aircraft  characteristics  in  the  regression  model.  Because  these 
NARM  values  are  budget-constrained  numbers,  it  is  uncertain  that 
they  represent  the  true  physical  relationships  between  aircraft 
characteristics  and  support  costs.  In  the  technical  language  of 
regression  analysis,  the  equations  are  misspeclfied  because  the 
NARM-derived  dependent  variables  may  be  the  result  of  budgeting 


^The  NARM  (Navy  Resources  Model)  is  a ccnputerized  data  management  systan, 
operated  by  OP-901  and  used  by  the  Navy  to  illustrate  the  distribution  of 
total  Navy  resources.  Originally  conceived  as  a nodellng  device  to  provide 
a rapid  response  capability  to  assess  the  impact  of  changes  in  force  levels 
on  Navy  resource  requirements,  its  role  within  the  Navy  PPBS  process  is  now 
considerably  expanded.  It  is  also  used  to  prepare  the  Department  of  Navy 
Five  Year  Procurement  Annex,  the  Navy  Program  Factors  Manual,  and  the 
program  years'  data  for  the  annual  Navy  Program  Objectives  M^randum  (PCW) 
submission.  All  data  input  to  the  NARM  may  be  classified  either  as  factors 
or  throu^put.  During  the  POM  process  these  data  are  either  flomished 
directly  by  the  CNO-desl0Tated  appropriation  sponsors  working  closely  with 
the  Navy  Systems  Comnands,  or  are  derived  from  the  data  supporting  the 
January  PYDP.  These  data  are  used  to  determine  initial  allocations  of 
funds  based  on  the  approved  program. 
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process  management  decisions  and  not  the  result  of  true  physical 
cost-aircraft  characteristics  relationships. 

The  P-l8  DSARC  II  costs  are  derived  from  the  8-variable 
model  and  presented  in  Table  6.  There  are  two  versions  of  the 
P-l8,  fighter  (VF)  and  attack  (VA) , and  the  O&S  costs  are  pre- 
sented for  both  versions. 

Table  6.  DSARC  II  F-18  O&S  COSTS 


Cost 

Categories 

Cost  per  Flying 
Hour  in  FY  75 

Doll ars ’ 

Cost  per  Aircraft 
per  Year  in  Thousands 
of  FY  75  Dollars’ 

VF 

VA 

VF 

VA 

Of f i cers ’ 

$ 258 

$ 271 

$108,453 

$113,617 

Enlisted’ 

585 

585 

245,797 

245.797 

Airframe  Rework 

88 

88 

37,136 

37,136 

Engine  Rework 

94 

94 

39,606 

39,606 

Component  Rework 

294 

304 

123,551 

127,592 

Rep  Spares 

212 

219 

89,242 

92,592 

POL 

267 

283 

112,195 

118,952 

Other  Consumables 

205 

212 

86.230 

89,103 

Total 

$2,003 

$2  .056 

$842,210 

$864,395 

’Costs  rounded  to  the  nearest  dollar. 

*Based  on  utilization  of  35  flying  hours  per  month  per  aircraft. 
’Includes  direct  and  indirect  personnel  costs. 

Source:  NAVAIR,  F-13  OSS  Coat,  2 December  1975. 


Based  on  the  WSPD  which  provides  the  latest  Navy  policy 
projections  of  F-l8  deployment  and  utilization  plans,  five  and 
ten  year  O&S  costs  are  calculated  from  the  cost  data  in  Table  6. 
At  DSARC  II  the  5 year  F-l8  VF  O&S  costs  were  $2.55  billion  and 
the  F-l8  VA  costs  were  $1.78  billion;  the  10  year  costs  were 
F-18  VF  - $3.57  billion  and  F-l8  VA  - $2.56  billion.  However, 
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the  costs  are  not  shown  at  the  specific  equipment  level,  so 
avionics  visibility  is  not  present  in  this  cost  estimating 
exercise . 


1 


( 2 ) The  Regression  Analysis  Development 

The  regression  equations  were  developed  by  NAVAIR,  MCAIR, 
and  Information  Spectrum  Incorporated,  a NAVAIR  consultant 
firm.*  The  equations  were  then  provided  to  MCAIR  and  the  O&S 
estimates  for  airframe  rework,  component  rework,  replenishment 
spares,  and  other  consumables  in  Table  6 were  produced.  Accord- 
ing to  NAVAIR  and  MCAIR,  the  equations  were  tested  for  signifi- 
cance and  found  to  be  acceptable. 

The  coefficients  of  the  equations  are  the  results  of 
regressing  data  for  nine  Navy  aircraft:  A-^F,  A-6E,  A-7E,  P-4J, 
P-l^A,  F-8J,  A-6A,  A-7A,  and  F-i|B.  Basic  aircraft  characteristic 
data  were  provided  MCAIR  by  NAVAIR  for  the  following  categories: 
maximum  velocity,  empty  weight,  flyaway  costs,  airframe  costs, 
avionics  costs,  propulsion  costs,  number  of  engines,  and  thrust 
per  engine.  Flyaway  costs  (unit  production  cost)  estimates 
were  derived  from  past  and  current  procurements  and  adjusted  to 
a 1975  base  year  price  index.  These  flyaway  costs  on  the  nine 
aircraft  were  then  sub-divided  into  airframe,  avionics,  and 
propulsion  based  on  the  experience  with  recent  aircraft. 

O&S  data  provided  from  the  NARM  for  each  of  the  nine  air- 
craft include  progressive  air  rework  (PAR)  cost,^  PAR  cost  per 
flying  hour,  component  rework  cost  per  flying  hour,  replenish- 
ment spares  cost  per  flying  hour,  other  consumables  cost  per 
flying  hour,  and  engine  overhaul  costs  per  flying  hour.  These 


‘Based  on  work  done  at  the  Naval  Air  DeveJ.opment  Center  during  the  late 
1960s.  These  equations  are  parametric  regressions. 

^Progressive  air  rewortt  (PAR)  is  progranmed  depot  level  maintenance  per- 
formed upon  accumulation  of  a predetermined  nunfcer  of  calendar  months  or 
flying  hours. 
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data  provided  the  values  of  the  dependent  variables  for  the 
regressions  which  developed  the  coefficients  in  the  final  F-l8 
equations.  Other  O&S  data  provided  by  the  Navy  for  the  nine 
aircraft  came  from  the  fleet  reliability  and  maintainability 
statistical  summary,*  and  included  mean  flying  hours  between 
failure  (MPHBP),  mean  flying  hours  between  maintenance  action 
(MPHBMA),  and  maintenance  manhours  per  flying  hour  (MMHPH). 

Each  of  these  reliability  and  maintainability  measures  is  for 
the  total  aircraft  system. 

The  judgment  decision  of  which  characteristics  to  use  as 
independent  variables  is  not  explained  by  the  NAVAIR  or  MCAIR 
documentation  of  the  cost  equations.  They  do  identify  the  key 
design  parameters  which  they  believe  relate  best  to  the  depen- 
dent variables,  and  these  are  summarized  in  Table  7.  Some  of 
these  design  variables  are  clearly  proxies  for  other  variables 
that  are  the  real  drivers  of  the  O&S  costs  listed,  but  the 
proxies  are  used  because  the  real  drivers  cannot  be  obtained. 

As  an  example,  airframe  and  avionics  costs  are  used  as  proxies 
for  complexity  in  the  other  consumables  regression  equation. 

A detailed  discussion  of  independent  variables  used  as  proxies 
in  the  equations  is  provided  in  the  next  sections  which  discuss 
each  equation. 

( 3 ) Personnel  Equations 

The  basic  total  system  personnel  equation  is  for  enlisted 
maintenance  personnel  per  squadron.  Its  components  are:  the 
expected  direct  maintenance  manhours  per  flying  hour  (DMMH/FH), 
which  is  18.04  for  the  P-l8;  the  aircraft  utilization  rate 
(ACUTR);  and  a peacetime  productivity  rate  of  120  manhours  per 
month  per  person.  K is  the  number  of  aircraft  per  squadron  (12), 
and  1.82  is  an  expansion  factor  to  make  contractor-developed  MMH 


'Fleet  Material  Support  Office  Report  4790.A2142-01. 
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Table  7. 


KEY  DESIGN  PARAMETERS  RELATED  TO  04S 
COSTS  AS  IDENTIFIED  BY  NAVAIR 


Costs 

Related  F-18  Design  Variables 

Direct  Maintenance  Personnel 

Maintenance  manhours  per  flying 
hour  scheduled,  unscheduled  mainte- 
nance general  support 

Other  Personnel  Support 

Function  of  Navy  manning  policy  and  j 
not  subject  to  design  sensitivity 

Airframe  Rework 

Airframe  cost 

Maximum  velocity 

Empty  weight 

j Engine  Overhaul 

Engine  pipes  ' 

Modular  design 

! Component  Rework 

1 

Flyaway  cost 

Empty  weight 

Rel i abi 1 i ty 

Maximum  velocity 

j Replenishment  Spares 

1 

i 

Flyaway  cost 

Empty  weight 

Rel i abi 1 i ty 

Maximum  velocity 

POL 

Weight 

Drag 

Standard  Fuel  Consumption 

Other  Consumables 

1 

Airframe  costs 

Avionics  costs 

Rel i abi 1 i ty 

Maximum  velocity 

Source:  McDonnell  Aircraft  Company,  Life  Cycle  Coet,  Report  No.  HOC  A4041, 
6 February  1976. 


consistent  with  operational  Navy  experience.^  Although  the 
dependent  variable  in  the  equation  is  termed  "maintenance  and 
operating"  personnel  per  squadron,  there  are  no  operational 
personnel  included.  The  equation  is 

_ DMMH/FH(1.82)  (ACUTR)K 

^20 


*The  1.82  factor  was  developed  by  the  Naval  Air  Developanent  Center  to 
account  for  the  manhours  spent  in  activities  other  than  direct  wrench 
turning  such  as:  tool  and  material  checkout,  breaks,  portage  time,  and 
time  utilized  in  reading  maintenance  manuals. 
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where : 

MO  = maintenance  personnel  per  squadron 

DMMH  = direct  maintenance  manhours  per  flying  hour 

ACUTR  = aircraft  utilization  rate 

K = number  of  aircraft  per  squadron. 

Maintenance  management  personnel  are  dervied  by  analogy 
with  an  A-7E  squadron  work  center,  totaling  twenty-nine  person- 
nel: three  division  supervisors,  nine  shop  supervisors,  and 

seventeen  other  mainte.nance  management  and  staff  people. 

Enlisted  administrative  support  (EAS)  is  given  as  a function 
of  the  size  of  the  total  squadron,  including  officers  and  enlisted. 
The  equation  is 

EAS  = (-9.597  + 0.36i*x  - 0.0009683x^  + 0. 00000113x^)  1.2. 

These  numbers  of  maintenance,  management,  and  administrative 
personnel  are  multlpled  times  an  enlisted  billet  cost  of  $16,478 
per  year,  which  includes  direct  and  indirect  costs  based  on  the 
skill  levels  of  a typical  Navy  squadron. 

Plight  crew  officers  and  ground  crew  officers  are  based  on 
standard  factors  and  a billet  cost  of  $61,973  per  year. 

( 4 ) Airframe  Rework  Costs 

This  equation  is  one  of  the  regressions  discussed  earlier, 
with  scheduled  depot  level  maintenance  cost  (SDLM)  as  the  depen- 
dent variable  representing  airframe  rework  (PAR). 

SDLM  = 9.489  + 96 . 24  + 34.7(EW)  + 17.910(AC) 

where : 

SDLM  = scheduled  depot  level  maintenance  cost 

V = maximum  aircraft  velocity 
max 

EW  * empty  aircraft  weight 

AC  ■ airframe  cost. 
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NAVAIR  suggests  that  scheduled  depot  maintenance  costs  depend 
on  complexity,  size,  material  composition,  operational  environ- 
ment, and  specific  design  features.  Empty  weight  (EW)  Is  a 
proxy  for  size,  maximum  velocity  (V„„^)  Is  a proxy  for  ehviron- 
ment,  and  airframe  cost  (AC)  Is  a proxy  for  size,  complexity, 
and  design  features. 

(5)  Engine  Rework 

Because  the  PMOM  engine  that  is  used  on  the  F-l8  is  unique, 
NAVAIR  chose  not  to  develop  a regression  equation  and  instead 
performed  an  Industrial  engineering  analysis  to  arrive  at  the 
$9^.30  cost  per  flying  hour.  The  major  unique  feature  of  the 

is  that  it  will  be  overhauled  and  repaired  in  modules, 
not  as  a whole  engine.  The  engineering  base  estimate  is  that 
depot  overhaul  and  repair  costs  will  be  about  70  percent  of 
what  would  be  encountered  with  a non-modular  design.  Based  on 
this  estimate,  an  engine  rework  regression  equation  could  have 
been  prepared  which  incorporated  a .70  degradation  factor. 

(6 ) Component  Rework 

The  component  rework  (CRC)  regression  explains  the  cost 
of  scheduled  and  unscheduled  depot  component  repair.  These 
costs  are  dependent  on  complexity,  operational  environment, 
and  failure  rates.  The  depot  arrival  rate  is  directly  related 
to  the  Beyond  Capability  of  Maintenance  (BCM)  categories  1 
through  8 as  defined  by  the  Maintenance  and  Material  Management 
(3M)  system.^  The  equation  is 

CRC  = 105.673  + 31.918  [0.74(AF)  + (AV+PROP)] 

*BCM  codes  1 throu^  8 define  actions  that  require  an  intermediate  mainte- 
nance shop  to  send  an  item  on  to  depot  for  repair:  repair  not  authorized, 
lack  of  equipment,  technical  sld.lls,  parts,  technical  data,  a shop  back- 
log, budgetary  limitations,  and  excess  of  local  requirements. 
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where : 


CRC 

= 

component  rework  cost 

AF 

= 

airframe  flyaway  cost 

AV 

= 

avionics  flyaway  cost 

PROP 

= 

propulsion  flyaway  cost 

EW 

= 

empty  aircraft  weight 

MPHBF 

= 

mean  flight  hours  between  failure 

V 

max 

= 

maximum  aircraft  velocity. 

According  to  NAVAIR,  empty  weight  (EW)  is  a proxy  for  size, 
maximum  velocity  is  a proxy  for  environment,  airframe 

flyaway  cost  (AF)  is  a proxy  for  quantity  of  components  and 
complexity,  and  mean  flight  hours  between  failure  (MPHBF)  is 
a proxy  for  BCM  rates.  The  avionics  and  propulsion  portions 
of  flyaway  costs  are  included  as  additional  proxies  for  a 
quantity  of  components  and  complexity.  This  is  the  only 
appearance  of  avionics  in  the  component  rework  relationship, 
and  it  is  only  as  a lump  sum  of  acquisition  cost. 

( 7 ) Replenishment  Spares 

The  regression  equation  for  replenishment  spares  cost  (RSC) 
takes  exactly  the  same  form  as  the  one  for  component  rework. 

It  has  the  same  Independent  variables  and  even  coincidently 
carries  the  same  coefficient  (0.7^)  in  the  second  term. 

RSC  = 76.3276  + 23.0644[0.74(AF)  + (AV+PROP)] 

+ 6.0996  - 0-0389(Vj^^^)  , 

where : 

RSC  = replenishment  spares  costs 

AF  = airframe  flyaway  cost 

AV  = avionics  flyaway  cost 

PROP  * propulsion  flyaway  cost 

EW  * empty  aircraft  weight 

MFHBP  ■ mean  flight  hours  between  failure 
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A, 


V = maximum  aircraft  velocity, 
max 

Complexity,  operational  environment,  and  condemnation  rates 
(BCM  code  9)  are  identified  as  the  real  spares  cost  drivers. 
Again  empty  weight  is  a proxy,  this  time  for  quantity  of  com- 
ponents; flyaway  costs  of  airframe,  avionics,  and  engine  are 
proxies  for  quantity  and  complexly;  and  maximum  velocity  is  a 
proxy  for  environment.  Condemnation  (BCM-9)  rates  are  proxied 
by  mean  flight  hours  between  failure  (MFHBF).  In  the  component 
rework  equation,  MFHBF  was  used  as  a proxy  for  all  the  other 
BCM  categories  except  for  condemnations.  Although  unstated, 
the  dual  use  of  MFHBF  as  the  proxy  for  non-condemnation  and 
condemnation  depot  arrivals  implies  an  assumption  about  stabil- 
ity of  the  relative  proportions  of  condemnations  to  the  BCM 
depot  returns. 

(8)  POL  Cost 

POL  cost  is  estimated  from  the  latest  information  on  F^04 
engine  performance  characteristics. 


( 9 ) Other  Consumables  Costs 

Other  consumables  (OC)  consist  of  non- repairable  material 
used  in  organizational  and  intermediate  maintenance,  repair  of 
repalrables  and  items  related  to  health,  safety,  and  welfare 
of  the  aircraft  crew.  The  equation  is 


OC 


291  - 


3^5.7 

(AV+AF) 


+ 18.^3 
MFHBF 


+ 


0.025V 


max 


where : 

OC  = other  consumables  cost 

AV  = avionics  flyaway  cost 

AF  = airframe  flyaway  cost 

MFHBF  = mean  flight  hours  between  failure 

Vmax  “ maximum  aircraft  velocity. 


9*1 


[ 


The  real  drivers  and  their  proxies,  according  to  NAVAIR,  are: 

I quantity  and  complexity,  proxied  by  airframe,  (AF)  and  avionics 

( (AV)  cost;  and  environment,  proxied  by  maximum  velocity  (V  ). 

niaX 

* The  MFHBF  of  the  aircraft  is  included  as  a real  cost  driver  by 

assertion  with  no  intuitive  explanation. 

b . The  NAVAIR  F-18  Subsystem  Baseline  Tracking  Model 

( 1 ) Basic  Form  and  Uses 

The  NAVAIR  subsystem  baseline  tracking  model  calculates 
O&S  costs  in  five  cost  categories  for  the  twenty-three  two-digit 
WUCs  that  define  the  F-l8  at  the  subsystem  level.*  This  model 
was  implemented  following  DSARC  II  (December  1975)  and  is 
designed  to  permit  NAVAIR  to  track  changes  from  initial  base- 
lines over  time  in  the  costs  of  direct  maintenance  personnel; 
component  rework;  replenishment  spares;  other  consumables; 
and  POL. 

The  model  is  internal  to  NAVAIR,  and  each  cost  equation  is 
sensitive  to  key  design  parameters  that  are  reported  to  NAVAIR 
by  MCAIR  (the  F-l8  prime  contractor).  It  provides  NAVAIR  with 
an  in-house  cost  tracking  capability  that  focuses  on  trends  in 
the  five  O&S  cost  categories.  It  should  be  emphasized  that  the 
equations  are  not  intended  to  provide  absolute  independent 
validations  of  the  absolute  values  of  O&S  costs  reported  by 
MCAIR  and  subsequently  reported  to  OSD  through  the  DSARC  pro- 
cess.* The  NAVAIR  tracking  equations  are  intended  solely  as 


*The  twenty-three  WUCs  and  their  nomenclatures  are:  WUC  11,  airframe; 

WUC  12,  fuselage  conpartments ; WUC  13,  landing  gear;  WUC  ih,  flight  con- 
trols; WUC  2h,  auxiliary  power  unit;  WUC  27,  turbofan  engine;  WUC  29 
power  plant  Installation;  WUC  4l,  environmental  control  system;  WUC 
electrical  system;  WUC  45,  hydraulic  system;  WUC  46,  fuel  system;  WU 
oxygen  system;  WUC  51 » Instruments;  WUC  56,  flif^t  reference;  WUC  57, 
internal  guld^ce/fligit  control;  WUC  63,  UHF  comunl cations  system; 

WUC  67,  Integrated  COMM/NAV/IFF;  WUC  72,  radar  navl^tlon;  WUC  73,  boirb 
navigation;  WUC  74,  we^xjns  control;  WUC  75,  weapons  delivery,  WUC  76, 
electronic  countermeasures;  WUC  91,  emergency  equipment. 

! 

a 
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barometers  of  trends  from  the  Initial  baseline.  A trend  Judged 
undesirable,  or  violent  deviation  from  a trend,  can  serve  as  a 
signal  that  a particular  design  parameter  requires  management 
attention  by  both  NAVAIR  and  MCAIR. 

The  five  equations  are  simple  algebraic  statements  that 
depend  on  given  standard  factors  and  design  parameters  that 
vary  by  WUC.  The  direct  maintenance  personnel  equation  is 
sensitive  to  changes  in  maintenance  manhours  per  flying  hour, 
and  the  POL  equations  is  sensitive  to  gallons  consumed  per  fly- 
ing hour.  The  other  three  equations  for  component  rework, 
replenishment  spares,  and  other  consumables,  are  sensitive  to 
acquisition  cost  by  WUC  and  mean  flight  hours  between  failures 
by  WUC. 

( 2 ) The  WUC-Level  Baseline  for  Component  Rework, 
Replenishment  Spares,  and  Other  Consumables 

The  three  equations  for  component  rework,  replenishment 
spares,  and  other  consumables,  arrive  at  the  two-digit  WUC 
code  level,  by  taking  P-4J  3M  data  for  labor  and  material  dol- 
lars per  flying  hour  and  constructing  percentages  of  labor  and 
material  by  WUC.*  These  percentages  are  then  applied  to  the 
DSARC  II  values  of  component  rework,  replenishment  spares,  and 
other  consumables  calculated  by  the  "total  system  model"  regres- 
sion equations  and  given  in  Table  6 earlier.^  Once  these 
DSARC  II  values  are  allocated  to  WUC  based  on  the  F-i<J  per- 
centages, the  allocated  values  are  entered  into  the  equations 
as  WUC  unique  constants.  These  constants,  based  on  the  original 
DSARC  II  calculations  and  the  F-4J  experience,  remain  fixed 
throughout  the  useful  life  of  the  subsystem  tracking  model. 


'The  P-^  data  were  taken  from  the  Pif  3M  RECAP  report. 

*The  absolute  values  used  in  the  subsystem  tracking  equations  are  actually 
rounded  values  of  those  listed  in  Table  8.  Conponent  reworic  is  rounded 
to  $300  per  flying  hour,  and  replenishment  spares  and  other  consimables 
are  both  rounded  to  $200  per  flying  hour. 
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Table  8.  F-4J  COMPONENT  REWORK 
ALLOCATION  PERCENTAGES 
USED  FOR  THE  F-18  SUB- 
SYSTEM TRACKING  MODEL 


Labor 

Material 

wuc 

Portion 
of  $300 

A1  located* 

m 

Portion 
of  $300 

A1 1 ocated* 

11 

3.21 

$ 9.63 

1.53 

$ 4.59 

12 

0.31 

0.93 

0.21 

0.63 

13 

4.00 

12.00 

2.88 

8.64  1 

14 

3.30 

9.90 

2.34 

7.02 

24 

2.60 

7.80 

2.16 

6.48 

27 

7.85 

23.55 

6.52 

19.56 

29 

0.33 

0.99 

0.45 

1.35 

. 41 

2.30 

6.90 

2.05 

6.15 

42 

2.24 

6.72 

2.34 

7.02 

45 

1.71 

5.13 

1.51 

4.53 

; 46 

1.26 

3.78 

0.97 

2.91 

0.49 

1.47 

0.22 

0.66 

51 

3.74 

11.22 

2.56 

7.68 

56 

3.10 

9.30 

3.15 

9.45 

57 

1 .05 

3.15 

0.52 

1 . 56 

’ 63 

0.82 

2. 4S 

1 . 26 

3.  78 

67 

0.55 

1 . 65 

0.39 

1.17 

72 

1 . 97 

5.91 

1.55 

4.65 

73 

4.93 

14.79 

2.25 

6.75 

74 

6.85 

20.55 

10.23 

30.69 

75 

2.05 

6.15 

1 .46 

4.38 

76 

0.  79 

2.37 

0.  77 

2.31 

91 

0.14 

0.42 

0.20 

0.60 

'The  oercentanes  in  the  two  percentage  columns  add  to  100T, 
indicatinr  that  the  total  component  rework  dollars  on  the 
F-4J  were  allocated  exhaustively  to  the  WUCs  listed. 

*The  dollar  amounts  in  the  two  dollar  columns  add  to  $300, 
the  value  of  the  DSARC  11  component  rework  calculation 
for  the  F-18,  indicating  that  the  total  sum  is  allocated 
exhaustively  to  the  WUCs  listed. 

Source:  F-IS  Sub-Syetem  Ofierating  md  Support  Coat 
Traoking  Report,  Harok  1977,  Naval  Weapons 
Engineering  Support  Activity,  Hanagement 
Engineering  Department,  prepared  for  NAVAIR 
Logistics  Management  Division,  Advanced 
Development  Branch. 
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the  maintenance  and  logistics  characteristics  of  the  two  WUCs 
were  deemed  to  be  essentially  the  same  by  NAVAIR. * 

Once  the  component  rework  DSARC  II  value  was  allocated  to 
P-l8  WUCs  as  shown  in  Table  8,  these  values  were  Introduced 
into  each  WUC  component  rework  equation  as  constant  terms. 
There  are  twenty-three  component  rework  equations,  and  each 
equation  has  a value  for  labor  cost  and  material  cost  derived 
in  the  manner  described  above.  As  an  example,  the  component 
rework  cost  tracking  equation  for  WUC  72  (radar  navigation) 
is 

$CR.^2  = j^$5.91  +^$4.65  • 

where : 

CR  = component  rework 

UPC  = baseline  production  cost  by  WUC 

UPC  latest  update  of  production  cost 

MFHBF  = baseline  mean  flight  hours  between  failure 

MFHBF’  = latest  update  of  MFHBF 

FH  = total  flight  hours  for  all  aircraft. 

Ignoring  the  other  terms. in  the  equation  until  the  later 
detailed  discussion  of  each  cost  category  equation,  it  is  the 
$5.91  and  the  $^.65  that  are  of  Interest.  These  are  allocated 
values  of  labor  component  rework  dollars  ($5.91)  and  material 
component  rework  dollars  ($4.65)  that  remain  the  same  for  all 


*rne  allocation  percentage  for  WUC  24  was  developed  by  taking  the  F-4J  WUC 
27  percentage  and  multiplying  it  by  a ratio  of  MWFH  for  WUC  24  and  WUC 

WUC  24«  = WUC  21%  WUC  24  MWFH. 

WUU  2*4%  WUO  dIT,  27  MVH/PH 


The  yWI/FH  values  were  taken  from  MCAIR's  6 April  1976  report  to  NAVAIR. 
NAVAIR  does  not  explain  whether  the  WUC  24  labor  and  material  percentages 
were  deducted  from  WUC  27  to  pemlt  the  total  percentages  to  still  add  to 
100?,  or  whether  all  WUCs  were  reduced  proportionally  to  make  up  the  WUC 
24  percentages,  or  whether  some  other  procedure  was  used. 
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calculations  of  component  rework  dollars  for  WUC  72  ($CRy2). 
Thus,  the  baseline  for  component  rework  cost  for  the  P-l8  Is 
firmly  grounded  In  the  Initial  DSARC  II  total  system  cost 
calculations.  Deviations  from  the  baseline  will  be  caused  by 
changes  In  the  other  terms  In  the  equation,  which,  excluding 
flying  hours  (FH),  NAVAIR  offers  as  design  sensitive.  This 
will  be  explored  more  completely  In  the  later  equation  dis- 
cussions . 

The  procedure  for  the  other  WUCs  Is  the  same  as  for  WUC 
72.  Constants  taken  from  the  allocated  values  In  Table  8 are 
entered  In  each  WUC  component  rework  equation. 

Similar  allocations  of  DSARC  II  total  system  calculations 
are  made  to  all  twenty-three  WUCs  for  replenishment  spares  and 
other  consumables.  Again,  F-J4J  data  are  used  to  construct  the 
percentages,  then  these  percentages  are  multiplied  times  the 
DSARC  II  calculated  values  for  replenishment  spares  ($200/FH) 
and  other  consumables  ($200/FH).  These  values  are  then  entered 
as  constants  Into  their  respective  WUC  equations.  The  only 
difference  is  that  the  percentages  for  replenishment  spares  and 
other  consumables  are  not  broken  out  by  labor  and  material  as 
they  are  for  component  rework. 

( 3 ) Direct  Maintenance  Personnel  Cost  Equation 

This  cost  Is  defined  as  the  cost  of  enlisted  squadron 
level  operating  and  maintenance  personnel  at  both  the  organiza- 
tion and  intermediate  levels  of  maintenance.  The  equation  Is 

- (-»-)  {^)  AC  - YBs) 

where : 

DMP  * direct  maintenance  personnel  cost 

$/AC/YR  = dollars  per  aircraft  per  year 

MMH/FH  “ maintenance  manhours  per  flying  hour 
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#AC-YRs  = number  of  ilrcraft  for  total  number  of 

years  in  operation. 

The  direct  maintenance  personnel  cost  ($DMP)  is  equal  to  the 
baseline  value  of  maintenance  personnel  cost  for  a given  MMH/PH 
the  term  times  the  latest  reported  MMH/PH,  times  the 

total  number  of  aircraft  for  the  total  number  of  years  they 
will  be  in  operation.  This  equation  is  awkwardly  laid  out 
because  the  MMH/PH  seems  to  appear  twice  and  in  fact  seems  to 
cancel  itself  out.*  A clear  presentation  would  Indicate  that 
the  MMH/PH  in  the  first  expression  is  the  baseline  initial 
estimate,  while  the  MMH/PH  in  tlie  second  expression  is  the"^ 
current  reported  update  of  MMH/1'’H.  Rewriting  the  equation  for 
clarity  it  might  appear  as 

$DMP  = $/AC/YR  #AC(YRs) 

where  maintenance  manhours  per  flying  hour  prime  MMH/PH*  is 
the  current  update,  and  MMH/PH  is  the  initial  baseline  estimate 
Rearranged  this  way.  It  is  easier  to  see  that  if  the  current 
update  of  MMH/PH*  is  greater  than  the  initial  MMH/PH,  then  the 
$DMP  will  rise.  If  MMH/FH*  were  always  the  same  as  the  orig- 
inal baseline  MMH/PH,  then  $DMP  would  stay  at  the  baseline 
value . 

The  term  "number  of  aircraft  for  given  years"  (#AC-YRs) 
is  fixed  at  7609  for  all  WUCs . 


*The  discussion  in  the  subsystem  model  manual  (March  1977)  makes  an  error 
that  adds  to  the  cqn.fusion  in  initially  understanding  the  equation.  Ttie 
error  is  the  statment  that  the  term  $/AaAT^  "...is  a constant  cost  fac- 
tor vrtiose  value  is  7325  for  all  two-^f^f' work  unit  codes  and  is  based 
upon  $17.^4/MMi  and  35  PH/MO/AC . . . . " In  fact,  the  top  part  of  the  term 
$/AC/YR  is  equal  to  $7325 > and  this  is  the  same  for  all  WilCs  on  the 
assunptlon,  stated  in  the  manual,  that  dollars  per  maintenance  manhour 
equal  $17.^4,  and  that  the  number  of  fll^t  hours  per  year  per  aircraft 
equal  k?0  (35  per  month).  Now,  for  each  WUC  there  is  a separate  T'OTi/FH 
baseline  estimate,  and  applying  this  to  the  expression  generates  a base- 
line value  that  is  unique  to  that  WUC.  It  is  against  this  baseline  value 
that  the  new  estimate  of  MNH/FH  will  have  an  impact. 
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(4)  Component  Rework  Equation 

The  component  rework  equation  is 


$CR  = 


($LAB)  + 


UPC 

UPC 


')](! 


MFHBF  \ 
MFHBFy 


(PH) 


where : 


$CR 

= 

component  rework  dollars 

$LAB 

baseline  allocation  of  $300  DSARC  II  labor 
estimate  by  WUC 

$MAT 

= 

baseline  allocation  of  $300  DSARC  II 
materials  estimate  by  WUC 

UPC 

= 

baseline  production  cost  by  WUC 

UPC 

= 

latest  update  of  production  cost  by  WUC 

MFHBF 

baseline  mean  flight  hours  between  failure 
by  WUC 

MFHBF ' 

z 

latest  update  of  mean  flight  hours  between 
failure  by  WUC 

FH 

= 

total  flight  hours  for  all  aircraft  for 
full  life  cycle  = constant  = 2,629,670. 

The  equation  is  intended  to  capture  the  cost  of  repairing 
repairable  components  at  the  depot  including  scheduled  and 
unscheduled  arrivals.  Complexity,  operational  environment, 
and  failure  rates  are  identified  as  the  real  cost  drivers. 

Unit  production  cost  (UPC)  is  a proxy  for  complexity  and 
operational  enviropment , and  mean  flight  hours  between  failure 
is  a proxy  for  sch^dtiled  and  unscheduled  depot  arrivals. 

The  sensitivities  of  the  equation  are  that  $CR  rises  as 
UPC  rises  above  the  baseline  value  and  as  the  MFHBF  grows 
shorter  than  the  baseline  time  period. 

A separate  equation  is  set  up  and  exercised  for  each  WUC 
and  for  each  update  of  all  UPCs  and  MFHBFs. 


(5)  Replenishment  Spares  Equation 

The  replenishment  spares  equation  is 


$RS  = (REPBASE) 


UPC 

UPC 


MPHBF 

MPHBF* 


(FH) 


where : 

$RS 


= rep  spares  costs 


REP  BASE  = allocation  of  $200  DSARC  II  estimate  by  WUC 

= baseline  production  cost  by  WUC 

= latest  update  of  production  cost  by  V/UC 

= baseline  mean  flight  hours  between  failure 
by  WUC 

= latest  update  of  mean  flight  hours  between 
failure  by  WUC 

= constant  = 2,629>670.* 


UPC 

UPC 

MFHBF 

MFHBF ’ 

PH 


The  equation  is  written  to  capture  the  cost  of  repairable  com- 
ponents required  to  replace  items  which  are  beyond  economical 
repair  at  the  maintenance  levels.  It  is  the  same  equation  as 
for  component  rework,  with  a slight  difference  in  the  REP  BASE 
item.  The  DSARC  II  baseline  cost  is  not  broken  into  labor  and 
material  as  it  is  for  component  rework;  instead  it  is  allocated 
as  a lump  sum  called  REP  BASE.^  The  sensitivities  are  the  same 
as  for  component  rework. 


( 6 ) Other  Consumables  Equation 
The  other  consumables  equation  is 

$OC  . (OTHER  BASE)  (PH) 

where : 

$0C  * other  consumables  dollars 


'See  explanation  of  constant  in  previous  sectl(Mi  on  conponent  reworic 
equation. 

*See  earlier  discussion  in  Section  b. 
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OTHER  BASE  = allocation  of  $200  DSARC  II  estimate  by 
WUC 

UPC  = baseline  production  cost  by  WUC,  from 

MCAIR 

UPC  = latest  update  of  production  cost  by 

WUC  from  MCAIR 

MPHBF  = baseline  mean  flight  hours  between 

failure  by  WUC  from  MCAIR 

MFHBP'  = latest  update  by  WUC  from  MCAIR 

FH  = constant  = 2,269,270.* 

$OC  is  the  cost  of  operating  consumables  which  are  non-repair- 
able  materials  used  in  organization  and  intermediate  maintenance 
and  repair  of  repairables.  It  is  the  same  equation  as  for  com- 
ponent rework  and  rep  spares.  Like  rep  spares,  the  DSARC  II 
baseline  cost  is  not  broken  Into  labor  and  material  as  it  is 
for  component  rework;  instead  it  is  allocated  as  a lump  sum 
called  OTHER  BASE.^ 

(7)  POL 

POL  cost  is  based  on  engineering  performance  data  and  is 
calculated  only  for  WUC's  11  (airframe)  and  27  (turbofan 
engine) . 

(8)  Using  the  Baseline  System  Before  DSARC  II 

This  baseline  subsystem  tracking  model  is  currently  used 
in  the  F-l8  program  as  a post-DSARC  II  indicator  of  sudden  or 
persistent  changes  in  component  O&S  costs;  however,  its 
methodology  could  be  applied  to  O&S  cost  estimates  before  DSARC 
II  and  perhaps  even  as  early  as  DSARC  I. 

As  a costing  exercise  to  develop  a reasonable  approxima- 
tion of  future  O&S  costs  during  the  conceptual  phase  between 

*See  explanation  of  constant  in  previous  section  on  coirponent  rework 
equation. 

*See  earlier  discussion  in  Section  b. 


DSARC  0 and  DSARC  I,  the  methodology  could  provide  O&S  costs 
by  two-digit  WUCs . This  would  create  the  potential  to  assess 
high  O&S  cost  equipments  during  the  conceptual  stage  of  weapon 
system  definition,  and  offer  the  opportunity  to  make  trade-offs 
between  high  cost  equipments  and  performance  or  design  charac- 
teristics of  the  aircraft. 

As  a system  definition  exercise,  the  methodology  would 
permit  a proposed  aircraft  to  be  built  system  by  system  and 
costed  for  O&S.  A cost  target  could  be  derived  through  this 
process,  or  a cost  target  exogenously  determined  could  be 
worked  against  to  develop  alternative  sets  of  equipments  that 
would  be  consistent  with  the  target. 

The  methodology  as  applied  in  the  F-l8  case  requires  the 
following: 

(1)  acquisition  cost  estimates  to  be  used  as  inputs 
in  the  total  system  model  equations; 

(2)  physical  characteristics  of  the  aircraft  to  be 
used  as  inputs  into  the  equations; 

(3)  a reference  aircraft  for  which  cost  data  are 
available  by  two-digit  WUC,  and  these  data  are 
used  to  construct  percentages  of  cost  by  WUC, 
which  then  serve  as  the  allocation  factors 

to  distribute  the  parametrically  estimated 
total  O&S  costs  to  the  individual  WUC  equipments. 

This  methodology  could  be  tailored  more  narrowly  than  an 
entire  reference  aircraft.  Each  two-digit  WUC  equipment  could 
be  selected  from  a different  aircraft  if  the  equipments  on 
different  aircraft  were  more  analogous  to  the  proposed  systems 
than  ^the  equipments  on  a single  aircraft.  Allocation  factors 
based  on  analogous  WUC  equipments  instead  of  entire  aircraft 
should  offer  closer  approximation  of  the  new  systems. 

The  F-l8  application  of  this  methodology  is  based  on  PPBS 
data  thorugh  the  Navy  Resources  Model  (HARM),  but  the  metho- 
dology is  generally  applicable  to  other  data.  The  new  NALCOMIS 
O&S  Maintenance  Subsystem  (MS)  Report,  discussed  later  in  this 


chapter,  provides  support  cost  data  by  Type/Model/Serles  air- 
craft at  the  seven-digit  WUC  level  of  detail.  Total  system 
parametric  equations  based  on  these  data  and  allocated  to  WUCs 
according  to  the  experience  data  contained  in  the  MS  Report 
could  provide  an  application  of  the  baseline  tracking  metho- 
dology that  relys  on  actual  maintenance  action  reporting  sys- 
tems. This  possibility  is  discussed  in  greater  detail  in 
Chapter  IV.  • 


The  MCAIR  F-18  Subsystem  O&S  Model 


( 1 ) Basic  Form  and  Uses 

The  MCAIR  subsystem  O&S  model  is  based  on  a detailed  equip- 
ment level-.approach  that  uses  the  basic  techniques  employed  in 
the  Navy- level  of  repair  analyses  (LORA)  models.'  It  was  sub- 
mitted  to  NAVAIR  for  approval  more  than  a year  after  DSARC  II. 

It  combines  key  elements  of  reliability,  maintainability,  unit 
pricing  information,  and  Navy  operational  factors  to  compute 
logistics  support  costs  (LSC)  by  major  equipment.  As  the  P-l8 
moves  through  the  testing  program,  the  model’s  outputs  will  be 
compared  with  test  data  as  a verification  procedure. 


Table  9 displays  a typical  LSC  format  for  the  model  out- 
puts proposed  by  MCAIR.  For  each  work  unit  code  on  the  air- 
craft, including  those  broadly  identified  as  "avionics"  (WUC's 
51-76),  LSC  costs  will  be: 

(1)  Organizational  maintenance  labor  and  material 
(repairable  and  consumable)  dollars; 

(2)  Intermediate  maintenance  labor  and  material 
(repairable  and  consumable)  dollars; 


'MrL-STI)-1390  B (NAVY),  1 December  1976,  defines  level  of  repair  analyses 
(LORA)  as  a Justification  of  the  decision  to  repair  or  discard  a failed 
item  of  hardware  for  each  anticipated  maintenance  action  on  the  item.  This 
Justification  is  required  to  support  the  decision  to  repair  at  any  mainte- 
nance level.  Repair  of  an  item  is  removal  and  replacanent  of  a failed 
lower  Indenture  assentoly,  to  include  fault  verification  of  the  item,  fault 
isolation  and  replacement  of  the  f«iTed  lower  assembly,  and  item  test. 
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Table  9.  TYPICAL  MCAIR  O&S  SUBSYSTEM  LSC  COST  SUMMARY  FORMAT 
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(3)  Depot  maintenance  labor  and  material  (repair- 
able and  consumable)  dollars; 

(H)  Initial  spares  dollars; 

(5)  Replenishment  spares  dollars; 

(6)  "Other,"  including  packing,  handling,  storage, 
transportation,  and  administration  dollars. 


{ 2 ) Structural  Flow  of  Model 

The  structuring  of  the  model  begins  with  the  Navy's  opera- 
tional concept  contained  in  the  Weapon  System  Planning  Document 
(WSPD).^  Based  on  the  operational  concept,  maintenance  demands 
(removals,  repairs)  by  WUC  are  estimated  and  used  to  establish 
operational  factors  including  turnarounds  and  order-and-ship 
times.  A level  of  repair  analysis  is  then  conducted  which 
generates  the  Source,  Maintenance,  and  Recoverability  (SMR) 
codes  that  identify  each  piece  of  equipment  according  to, 

(1)  source  codes,  assigned  to  support  items  such  as 
spares,  repair  parts,-  component  parts,  kits, 
special  tools,  test  equipment,  and  ground  support 
equipment,  to  Identify  the  manner  of  acquiring 
items  for  maintenance,  repair,  or  overhaul; 

(2)  maintenance  codes,  assigned  to  support  items  to 
Identify  the  maintenance  levels  authorized  to 
remove  and  replace,  repair,  overhaul,  assemble, 
inspect  and  test,  and  condemn  items; 

(3)  recoverability  codes,  assigned  to  support  items 
to  Indicate  to  maintenance  and  supply  personnnel 
the  reclamation  or  disposition  action  required 
for  items  that  are  removed  and  replaced  during 
maintenance . 


^Ihe  WSPD  is  a Chief  of  Naval  Operations  (CNO)  document  that  contains  plan- 
ning Infonnation  for  the  initial  Introduction  of  new  weapon  systems.  It  is 
a basic  policy  and  planning  document  published  by  NAVAIR  deslgpied  to  pro- 
vide e^proved  CNO/CMC/NAVAIR  planning  for:  base  loadings,  procurements, 
delivery  schedules,  system  inventories,  planning  factors  Including  flying 
hours  and  authorized  operating  service  life,  material  support  policy 
including  spare  parts  support  and  level  of  repair,  training  plans,  and 
other  pertinent  planning  information. 
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The  SMR  codes  for  equipment,  combined  with  projected  mainte- 
nance demands  and  operational  factors,  lead  to  an  estimate  of 
maintenance  flows  (organizational,  interm.ediate.  Naval  Air 
Rework  Facility,  vender),  and  these  flows  permit  an  estimate  to 
be  made  of  direct  maintenance  costs  for  labor  and  materials  at 
three  levels  of  maintenance.  Initial  spares  requirements  are 
determined  based  on  the  previously  established  operational  fac- 
tors (turnarounds,  order-and-ship  times,  etc.),  and  replenish- 
ments spares  are  generated  based  on  maintenance  flows-malntenance 
cost  projections.  The  indirect  costs  of  spares  (administration, 
transportation,  packing,  facilities,  other)  are  determined  based 
on  the  initial  and  rep  spares  estimates,  and  these  are  then 
distributed  along  with  maintenance  and  spares  costs  against  WUCs 
to  produce  the  O&S  costs  estimates. 

d . CASEE  Simulation  Model 

The  Carrier  Aircraft  Support  Effectiveness  Evaluation 
(CASEE)  model  is  a simulation  aircraft  maintenance  technique  to 
provide  outputs  that  focus  on  squadron  readiness.  Input  require- 
ments are  large  and  include  aircraft  and  two-digit  WUC  reliability 
and  maintainability  characteristics,  unscheduled  maintenance 
activity,  scheduled  maintenance,  and  the  spares  and  resupply  flow. 
The  kinds  of  data  Inputs  into  CASEE  Include:  total  sorties 
scheduled  and  flown,  flight  hours,  maintenance  manhours  per 
flight  hour,  maintenance  actions  by  WUC,  failures  by  WUC,  orga- 
nizational level  manhours  per  maintenance  action,  and  aircraft 
t urnaround  t ime . 

During  the  conceptual  phase  of  a proposed  weapon  system, 

CASEE  generates  estimated  performance  data  and  proposed  support 
concepts  and  operational  requirements  alternatives.  During 
DSARC  II  additional  estimates  are  generated. 

By  varying  subsystem  reliability,  subystem  maintainability, 
spares  provisioning  and  level  of  repair,  the  effects  on  maintenance 
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manhours  per  flying  hour  and  maintenance  actions  by  WUC  can  be 
derived.  Also  developed  by  varying  reliability  and  maintain- 
ability are  the  effects  on  maintenance  manhours  by  WUC  for  each 
maintenance  action. 

The  potential  of  CASEE  as  a discriminator  among  alternative 
systems  is  high.  It  produces  logistics  data  when  certain  charac- 
teristics are  varied  for  individual  equipments. 

The  data  Inputs  to  CASEE  are: 

(1)  Squadron  complement  by  aircraft  type, 

(2)  Aircraft  system  and  subsystem  R&M  data, 

(3)  Mission  flights, 

(4)  Post-mission  activities, 

(5)  Unscheduled  maintenance, 

(6)  Spares  and  resupply  chain, 

(7)  Scheduled  maintenance. 

The  outputs  based  on  these  data  are: 

(1)  Total  sorties  scheduled, 

(2)  Total  sorties  flown, 

(3)  Total  flight  hours, 

(4)  Overall  squadron  readiness, 

(5)  Number  of  operationally  ready  and  full  systems 
capability  (FSC)  aircraft  at  beginning  of  each 
flying  day, 

(6)  Total  not  operationally  ready  (NOR)  hours  and 
percent  by  NOR  category, 

(7)  Total  reduced  material  category  condition  (RMC) 
percent  and  hours  by  RMC  category, 

(8)  Maintenance  manhours/flight  hour, 

(9)  Number  of  ground  aborts, 

(10)  Number  of  inflight  aborts, 

(11)  Maintenance  actions  by  work  unit  code, 

(12)  Failures  by  work  unit  code  (WUC), 

(13)  Bit — Detected  failures  by  WUC, 
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(14)  Manhours/maintenance  action  by  WUC  (organiza- 
tional level), 

(15)  Manhours/raaintenance  action  by  WUC  (inter- 
mediate level), 

(16)  Work  center 'utilization, 

(17)  Work  center  quelng, 

(18)  Parts  delay  by  WUC, 

(19)  Turnaround  time — aircraft  recovered  "up," 

(20)  Turnaround  time--alrcraft  recovered  "down," 
or  aborted  during  preflight  inspection. 

e . Equipment  Life  Cycle  Cost  Model 

The  Naval  Material  Command's  equipment  life  cycle  cost 

* 

(ELCC)  model  is  similar  to  the  AFLC  LSC  accounting  model  in 
that  a large  number  of  input  variables  (104)  are  combined 
through  simple  algebraic  equations  to  produce  equipment  level 
costs.  ^ The  major  difference  between  the ’€wo  models:  *1.3  ..that 
the  ELCC  model  is  Intended  for  total  LCC  coverage  while  the  Lc/C 
focuses  entirely  on  ten  cost  elements  for  logistic  support.  The 
ELCC  model  has  been  used  after  DSARC  II  but  before  DSARC  III. 

The  ELCC  model  has  three  broad  LCC  categories:  research 
and  develojtiment , investment,  and  operating  and  support.  These 
cost  elements  are  divided  into  eighty-five  sub-cost  elements, 
sixty-one  of  which  comprise  the  basic  questions.  The  basic 
equations  are  composed  of  one:  hundred  and  four  variables.  Each 
equation  belongs  to  one  of  the  cost  categories  and  funding  types 
listed  in  Table  10. 

The  model  produces  thirteen  reports  at  different  levels 
of  detail.  These  reports  are  listed  in  Table  11. 


'Naval  Weapons  Engineering  Support  Activity,  Management  Engineering  Depsirt- 
ment.  Cost  Management  Division,  is  the  custodian  of  the  model.  It  is 
presented  in  a Life  Cyele  Cost  Guide  for  Equipment  Analysis,  January  1977. 
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Table  10.  NAVY  EQUIPMENT  LIFE  CYCLE  COST  MODEL 
COST  CATEGORIES  AND  FUNDING  TYPES 


Cost  Categories 


Contractor  Payment 
Program  Management 
Testing 

Prime  Equipment 
Training 
Supply  Support 
Technical  Data 
Support  Equipment 
Operation 
Mai ntenance 


Funding  Type 


Research  and  Development 

Procurement 

Construction 

Operation  and  Maintenance 
Military  Personnel 
Others 


Table  11.  NAVY  EQUIPMENT  LIFE  CYCLE  COST  MODEL 
REPORTS 


Input  Data  Reports 


Equations 

Remarks 

Di  ct ionary 

Variable  Values 

Cost  Adjustment  Factors 


Output  Data  Reports 


Summary 

Funding  by  Cost  Category 

Cost  Breakdown  by  Year 

Cost  Breakdown  Totals 

General  Funding 

Annual  Cost  by  Funding 
Type 

Annual  Cost  by  Cost 
Category 

Sensitivity  Analysis 


The  computer  program  developed  for  the  ELCC  model  provides 
the  analyst  with  the  flexibility  to  modify  the  standard  model 
to  fit  specific  project  needs.  If  desired,  the  user  of  the 
model  can  redefine  the  entire  cost  structure.  This  flexibility 
means  that  the  ELCC  model  is  a basic  framework  around  which 
equipment  level  life  cycle  costs  can  be  structured.  The  one 
hundred  and  four  equation  variables  and  the  sixty-one  equations 
are  presented  in  Appendixes  F and  G. 

The  sixty-one  operating  and  support  equations  are  simple 
algebraic  models  for  calculating  sixty-one  of  the  eighty-five 
sub-cost  elements  under  the  three  broad  LCC  elements  (research 
and  development,  investment,  operating  and  support).  The 
operating  and  support  cost  elements  are  given  In  Table  12  and, 
for  each  O&S  element  followed  by  a "yes"  in  the  "equation  to 
calculate"  column,  there  is  a separate  equation  in  the  model. 
Each  of  the  "no"  entries  represents  a summation  of  calculated 
equations'  values. 

Data  for  the  104  variables  in  the  ELCC  model  are  provided 
through  the  system  project  office,  the  contractor,  and  the 
logistic  support  organization.  The  Project  Management  Office, 
Air,  (PMA)  will  provide  system  operations,  acquisition  costs, 
project  schedules,  and  contractual-related  data.  The  contractor 
is  responsible  for  the  inherent  design  characteristics  data. 

The  integrated  logistic  support  manager  has  access  to  data  on 
maintenance,  personnel  and  training,  technical  data,  and  other 
pertinent  data. 

4.  DATA  AND  MANAGEMENT  SYSTEMS 

a . The  Naval  Air  Logistics  Command  Management  Informa- 
tion System 

The  Naval  Air  Logistics  Command  Management  Information 
System  (NALCOMIS)  - Operating  and  Support  (O&S)  Visibility  of 
Management  and  Support  Costs  (VAMOSC)  Management  Information 
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Table  12.  EQUIPMENT  LIFE  CYCLE  COST  MODEL  OPERATING  AND 
SUPPORT  COST  ELEMENTS 


Equation  to  Calculate 


ELCC  O&S  COST  ELEMENTS 


OPERATING 

Operating  Personnel 
Operating  Facilities 
Operating  Energy  Consumption 
Operating  Material  Consumption 
Operating  Software  Maintenance 

SUPPORT 

Corrective  Maintenance  Labor 

Org-Int  Level  Remove  and  Replace 
Org-Int  Level  Repair 
Depot  Repair 
Repair  Material 
Transportation  and  Packaging 

Preventive  Maintenance 

Labor 

Material 

Overhaul 

Labor 
Material 
T rans  portati on 

Support  and  Test  Equipment  Maint. 
Facilities 

Documentation  Maintenance 

Supply  Support 

Replenishment  Spares 
Supply  System  Management 

Training 

Operator 

Org-Int  Level  Maintenance 
Depot  Level  Maintenance 


*Add-up  of  elements 


System  accumulates  data  from  various  sources  to  produce  three 
basic  reports — The  Total  Support  System  (TSS)  report,  the 
Maintenance  Subsystem  (MS)  report,  and  the  Maintenance  Sub- 
system detail  (MSD)  report.  Together  these  reports  contain  the 
operating  and  support  costs  of  Navy  and  Marine  aircraft  weapon 
systems  by  Type/Model/Series  (TMS)  for  a complete  fiscal  year. 
Samples  of  these  reports  are  presented  in  Appendixes  H (TSS) 
and  I (MSS  and  MSD). 

There  are  two  important  distinctions  between  the  TSS  and 
the  MS  and  MSD  reports.  The  first  is  that  the  TSS  reports 
cost  data  at  the  total  TMS  weapon  system  level  only,  while  the 
MS  and  MSD  report  cost  data  at  the  component  level  by  TMS.  The 
second  distinction  is  that  the  TSS  cost  data  are  based  on  budget 
data,  while  the  MS  and  MSD  costs  are  based  on  production  account- 
ing reports  at  organization,  intermediate,  and  depot  maintenance 
activities . 

b . The  TSS  Report 

All  aircraft  TMS  that  had  either  100  or  less  flying  hours 
or  contained  3 or  less  aircraft  during  the  fiscal  year  are 
listed  together  in  a miscellaneous  data  set  at  the  end  of  the 
TSS  report.  Aggregations  for  all  aircraft  are  also  listed  in 
a grand  summary  data  set  at  the  end  of  the  report.  The  remainder 
of  the  report  consists  of  four  data  pages  for  each  TMS  with  the 
data  arranged  into  cost  elements  for  organizational  support, 
intermediate  support,  depot  support,  training  support,  recurring 
Investment,  and  other  costs.  These  costs  are  available  by  major 
claimants  such  as  PACFLT,  LANTFLT,  NET,  MARINE,  RESERVE,  NAVAIR, 
OPNAV,  NAVEUR,  and  MISC.  Table  13  displays  the  cost  elements 
and  identifies  the  sources  of  the  data  which  fill  them.  The 
data  systems  rely  heavily  on  budget  and  accounting  data. 
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Table  13.  COST  ELEMENTS  AND  DATA  SOURCES 

IN  THE  NAVY  VAMOSC-AIR  TSS  REPORT 


Cost  Element 

Data  Source  | 

ORGANIZATIONAL  COSTS 

1 

1 Personnel:  military,  civilian. 

contract 

NCIS/OPS  ' 

Temporary  additional  duty 

NCIS/OPS*  . 

1 Training  expendable  stores 

SPCC/CAMIS  ’ 

1 Maintenance  supply 

OP-51  ’ 

, Personnel  support  supplies 

OP-51 

i POL 

OP-51  * 1 

1 Organizational  Subtotal  { 

INTERMEDIATE  COSTS 

i 

1 

Maintenance  supplies 

OP-51  ’ , ! 

Personnel;  military,  civilian. 

contract 

NCIS/OPS  ' S 

Intermediate  Subtotal  ' - 

1 DEPOT  COSTS 

Aircraft  rework 

AIR-AM" 

Engine  rework 

air-aia"  I 

Component  rework 

AIR-AIA* 

other  rework 

AIR-AIA‘  ! 

i Depot  Subtotal 

i 

j TRAINING  COSTS 

i Fleet  readiness  sguadrons  personnel;  military. 

1 civilian,  contract 

NCIS/OPS  ' 

FRS  temporary  additional  duty 

NSIC/OPS  , 

FRS  training  expendable  stores 

SPCC/fAMIS  ' 

FRS  maintenance  supplies 

OP-51 ; 

FRS  personnel  support  supplies 

OP-51  i 

FRS  POL 

OP-51  ’ ! 

FRS  Subtotal  1 

OtM  Training  Subtotal  j 

1 Operational  training  devices 

1 

(simulators  ) 

FASOTRAGRULANT*  1 
& FASOTRAGRUPAC*  1 

1 Maintenance  Training 

cnet‘  ' 

All  Training  Support  Subtotal 

1 

RECURRING  INVESTMENT 

' Replacement  repairables 

NADC  ’ 

Modifications 

AIR-01A6  * 

1 Recurring  Investment  Subtotal  j 

OTHER  FUNCTIONS 

NETS 

NASEU’ 

CETS 

NASEU’ 

j Publications 

NATSF  ' ' 

Other  Functions  Subtotal 

GRAND  TOTAL  FOR  ALL  PREVIOUS  COST 

ELEMENTS 

....  . 1 

'Navy  Cost  Infonnatlon  System/Operatlons  Subsystem. 

'Ships  Parts  Control  Center/Conventional  Amnunitton  Integrated  Management 
System. 

'Deputy  Chief  of  Naval  Operations,  Air  Warfare,  Aviation  Programs  Division. 
"Naval  Air  Systems  Command,  Logistics  Management  Division,  Depot  Management. 
'Fleet  Air  Support  Organization  Training  Sroup,  - Atlantic,  Pacific. 

‘Chief  of  Naval  Education  and  Training. 

’Naval  Air  Development  Center. 

'Naval  Air  Systems  Command,  Plans  and  Program  Dffice,  Configuration 
Management  Office. 

‘Naval  Aviation  Engineering  Service  Unit. 

"Naval  Air  Technical  Services  Facility. 
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The  categories  are  explained  as  follows: 


(1)  Personnel  costs.  The  organization  level  personnel 
costs  in  Table  13  under  the  first  subcategory 
(personnel;  military,  civilian,  contract)  are 

the  costs  attributable  to  flight  operations. 

(2)  Maintenance  supplies.  This  category  represents 
the  costs  of  repair  parts  for  organizational 
level  maintenance  under  the  organizational 
heading  and  the  costs  of  repair  parts  for  inter- 
mediate maintenance  under  the  intermediate  head- 
ing. The  repair  parts  for  Fleet  Readiness 
Squadrons  (FRS)  are  listed  separately  under  the 
training  support  heading  in  Table  5. 

(3)  Aircraft  rework.  The  maintenance  costs  for  air- 
craft rework  purchased  from  organizations  within 
DoD  and  from  commercial  organizations  are  listed 
here . 

(H)  Engine  rework.  The  maintenance  costs  for  engine 
rework  purchased  from  organizations  within  DoD 
and  from  commercial  organizations  are  listed  here. 

(5)  Component  rework.  The  maintenance  costs  for  com- 
ponent rework  purchased  from  organizations  within 
DoD  and  from  commercial  organizations  are  listed 
here . 

(6)  Other  rework.  The  costs  included  in  this  element 
are  for  all  hardware-oriented  programs  not  included 
in  the  aircraft,  engine,  and  component  rework  cate- 
gories, and  other  engineering  support  which  Includes 
the  costs  of  engineering  efforts  in  the  Cognizant 
Field  Activity  (CFA)  program. 

(7)  Replacement  repairables.  This  is  the  cost  of 
replacements  for  repairable  components  that  are 
required  to  maintain  adequate  inventory. 

(8)  Modifications . This  category  displays  the  pro- 
curement costs  of  modifications  required  by  a 
specific  TMS . Included  are  the  associated 
logistic  support  Investment  costs  and  non- 
recurring engineering  costs  as  well  as  the 
recurring  kit  costs. 


c . The  MS  Summary  Report 


The  MS 
and  support 
nance  costs 


report  presents  a summary  of  component  maintenance 
costs  by  TMS,  with  scheduled  and  unscheduled  mainte- 
displayed  at  the  organizational,  intermediate,  and 
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depot  levels.  There  is  one  page  for  each  TMS  aircraft,  with 
costs  of  labor  and  consumables  associated  with  the  maintenance 
actions  on  the  WUC  equipments.  The  data  sources  are  the  3M 
system,  NARP  data  bases,  and  ASO  contract  data  inputs.  According 
to  the  MS  report  introduction,  NADC  has  incorporated  ’’statistical 
adjustments"  Intended  to  minimize  the  problems  associated  with 
multi-source  data  bases  and  inconsistencies  in  source  data 
reporting.  Some  of  these  inconsistencies  are  a reference  to 
criticisms  of  3M  data,  and  the  adjustments  are  the  NADC  "ideal 
squadron"  adjustment  factor.*  Because  of  the  statistical  adjust- 
ments, the  MS  report  narrative  advises  that  "...the  costs  gener- 
ated in  this  manner  may  not  be  directly  comparable  at  this  time 
with  related  cost  elements  in  the  TSS . " Whether  these  costs  in 
the  MS  report  will  ever  be  directly  comparable  with  the  costs  in 
the  TSS  report  is  unknown.  Table  1^  below  presents  the  MS  report 
cost  elements. 

The  categories  are  explained  as  follows : 

(1)  Maintenance . The  maintenance  category  for  organiza- 
tion and  intermediate  in  Table  11  consists  of  the 
resources  utilized  in  the  performance  of  separately 
identifiable  scheduled  and  unscheduled  maintenance 
actions  reported  on  the  3M  Maintenance  Action  Form 
(MAP) . 


* Because  there  is  mich  criticism  and  generally  accepted  "conventional  wis- 
dom" that  3M  data  reporting  is  uneven  and  unreliable,  the  NB  attempts  to 
adjust  for  these  possibilities.  Good  squadron  reporters  are  selected  to 
determine  average  costs  that  will  be  applied  to  all  squadrons.  The 
selection  of  these  good  squadrons  is  a very  sophisticated  process,  and  it 
amounts  to  a seirles  of  rules  by  which  squadrons  are  identified  as  bad 
reporters  and  are  thereby  eliminated  from  the  average  cost  calculations 
for  labor  and  consumables.  There  are  two  measures  of  fli^t  activity 
reported  to  NADC,  one  is  the  dally  fli^t  sumrary  by  tall  number  on  the 
76-card,  the  other  is  the  monthly  squadron  surmaty  also  reported  by  tall 
number  and  on  the  79-card.  One  way  to  measure  "good  reporting  squadrons" 
is  the  consistency  between  the  total  of  the  dally  fli^t-sunmary  cards  for 
over  a month  and  the  total  reported  on  the  monthly  squadron  sumnary.  NADC 
does  not  accept  a squadron’s  data  if  there  is  a 20  percent  or  more  varia- 
tion in  the  surmarles.  Generally,  by  the  end  of  the  flscail  year  the  data 
can  be  reconciled  and  accepted. 
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Table  14.  COST  ELEMENTS  IN  THE  NAVY  VAMOSC-AIR 
MS  REPORTS 


Level  of  Detail 

Cost  Categories 

Organization  costs  at 

NAINTENANCE 

i 

2-d1a1t  Work  Unit  Code 

Level  of  Detail 

Labor  scheduled 

Labor  unscheduled 

Consumables  scheduled 
Consumables  unscheduled 

] 

1 

SUPPORT  LABOR 

1 

1 

TECHNICAL  DIRECTIVE  COMPLIANCE 
LABOR 

j 

Intermediate  cos*'  at 

NAINTENANCE 

. 

2>d1g1t  Work  Unit  Code 

Level  of  Detail 

Labor  scheduled 

Labor  unscheduled 

Consumables  scheduled 
Consumables  unscheduled 

n 

SUPPORT  LABOR 

TECHNICAL  DIRECTIVE  COMPLIANCE 
LABOR 

ATTRITION 

Depot  costs  at  2>d1g1t 

COMPONENT  REPAIR  ACTIONS 

Work  Unit  Code  Level  of 

Detail 

NARF 

Direct  labor 

Indirect  Labor 

Material 

1 

Commercial 

SURVEYED  REPAIRABLES 

TECHNICAL  DIRECTIVE  COMPLIANCE 
LABOR 

_ 

Costs  reported  only  as 

PRE-EXPENOED  MATERIAL 

sums  for  entire  aircraft, 
not  for  each  2-d1g1t  Work 

ORGANIZATIONAL  SUPPORT  LABOR 

Unit  Code 

TECHNICAL  DIRECTIVE  COMPLIANCE 
MATERIAL  COSTS 

Organization 

Intermediate 

Depot 

(2)  Labor  scheduled.  The  costs  for  direct  labor  for 
preplanned  maintenance  actions  as  reported  on  the 

MAP  and  the  associated  portion  of  maintenance  = 

personnel  salaries  identified  for  each  applicable 
WUC  are  carried  here  under  organization  and  inter-  j 

mediate  maintenance  in  Table  14. 

4 
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(3)  Labor  unscheduled.  This  category  is  explained  the 
same  as  the  labor  scheduled  category  above,  except 
for  maintenance  actions  other  than  scheduled. 

(i')  Consumables  scheduled.  This  is  the  cost  of  Navy 
Stock  Fund  (NSF)  repair  parts  used  to  perform 
scheduled  maintenance,  both  at  the  organization 
and  intermediate  levels. 

(5)  Consumables  unscheduled.  This  is  the  cost  of  NSF 
repair  parts  at  organization  and  intermediate  levels 
used  to  perform  maintenance  actions  other  than 
sche^Juled. 

(6)  Support  labor.  This  is  the  direct  labor  reported 
on  the  3M  SAF  (Support  Action  Form)  for  organiza- 
tion and  intermediate  levels. 

(7)  Technical  directive  compliance  labor.  The  direct 
labor  as  reported  on  the  3M  TDC  (technical  direc- 
tive compliance)  form  is  entered  here  for  the 
organization  and  intermediate  levels  in  Table  14. 

(8)  Attrition . Under  the  intermediate  level  in  Table  14, 
this  category  is  the  replacement  value  of  normally 
repairable  components  of  a given  TMS  which  are 
found  to  be  beyond  the  point  of  economical  repair 

at  the  intermediate  level.  It  is  based  on  actual 
unit  replacement  costs  and  actual  fiscal  year 
attrition,  not  on  expenditures  since  all  items 
are  not  necessarily  replaced  within  a given 
fiscal  year. 

(9)  Depot . This  category  Is  based  on  actual  Beyond 
Capability  of  Maintenance  (BCM)  actions  at  the 
intermediate  level;  not  all  BCMs  are  reworked 
at  the  depot  within  a given  fiscal  year. 

(10)  Component  repair  actions.  This  consists  of  the 
costs  reported  to  ASO  of  the  direct  labor,  in- 
direct labor,  material  costs  associated  with 
reworking  enough  components,  for  each  WUC,  to 
replace  not-ready-for-issue  components  sent  to 
the  depot  by  intermediate  level  BCM  actions. 

The  cost  for  a given  WUC  is  obtained  from  the 
average  rework  cost  for  the  WUC  and  the  BCM  rate 
for  the  WUC. 

(11)  Direct  labor.  This  category  under  NARF  compoJ'.ent 
repair  actions  in  Table  1^  is  the  direct  labor 
associated  with  reworking  components  reported  by 
intermediate  level  BCM  actions. 
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(12)  Indirect  labor.  This  category  under  NARF  in 
Table  14  is  the  overhead  indirect  labor  asso- 
ciated with  reworking  components  reported  by 
intermediate  BCM  actions. 

(13)  Surveyed  repalrables.  This  is  the  replacement 
value  of  normally  repairable  components  which 
are  found  to  be  beyond  the  point  of  economical 
repair  at  the  depot  level,  and  is  based  on 
actual  repair/survey  rates . 

As  a check  on  the  consistency  between  the  TSS  and  the  MS, 
vre  computed  maintenance  cost  per  flying  hour  for  six  TMS  air- 
craft from  both  the  TSS  and  the  MS. 

As  can  be  seen  in  Tables  15,  l6,  and  17  below,  the  fol- 
lowing statements  are  substantiated  for  this  sample  of  TMS 
depot  component  repair  costs  per  flying  hour: 

(1)  The  rankings  of  low  to  high  cost  TMS  are  con- 
siderably different  in  the  two  reports  for 
the  six  TMS  examined. 

(2)  The  absolute  dollar  differences  for  any  one 
TMS  between  the  TSS  and  MS  costs  are  con- 
siderable . 

(3)  The  percentage  differences  between  TSS  and  MS 
costs  are  not  consistent  for  all  TMS;  that  is, 
for  some  TMS  the  MS  cost  is  greater  than  TSS 
cost,  for  others  the  reverse  is  observed. 


d . The  MSP  Report 

The  MSD  report  is  produced  for  each  TMS  aircraft  and  com- 
prises 22  pages  of  maintenance  subsystem  data.  It  is  the  detail 
backup  for  the  MS  summary  report.  The  first  page  of  the  report 
is  Identical  to  the  single  page  for  that  particular  TMS  aircraft 
that  appears  in  the  MS  report  described  above.  The  subsequent 
pages  of  the  MSD  report  are  additional  detail  that  lie  behind 
the  single  summary  page,  as  well  as  maintenance  data  that  are 
not  summarized  on  the  summary  page.  The  acronym  MSD  was  created 
to  distinguish  this  detailed  report  from  the  summary  MS  report. 
In  fact,  the  Navy  classes  both  reports  the  MS  renort . Owing  to 
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Table  15. 


COMPARISON  OF  SIX  TMS  AIRCRAFT  DEPOT 
COMPONENT  MAINTENANCE  COST  PER  FLYING 
HOUR  RANKINGS  IN  TSS  AND  MS  FOR  FY  75 
DATA  FROM  1976  VAMOSC-AIR 


TMS 

MS  Rank* 

TSS  Rank* 

F-8H 

1 

3 

F-4N 

2 

4 

F-4B 

3 

6 

F-8J 

4 

2 

F-4K 

5 

5 

F-8K 

6 

1 

*In  each 

column,  rank  1 is 

lowest  cost,  rank  6 

is  highest. 
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Table  16.  DEPOT  COMPONENT  MAINTENANCE  COSTS  (DCMC)  AND 
FLYING  HOURS  (FH)  FOR  SIX  TMS  AIRCRAFT  IN  THE 
TSS  AND  MS  FOR  FY  75  (1976  VAMOSC-AIR) 


TMS 

MS  DCMC 

TSS  DCMC 

Flyi ng 
Hours 

MS 

$/FH 

TSS 

$/FH 

F-4B 

$ 3,123,000 

$ 4,587,000 

1 7708 

$176 

$259 

F-4J 

16,672,000 

14,981 ,000 

85695 

194 

174 

F-4N 

4,348,000 

5,104,000 

31625 

137 

161 

F-8H 

1 ,183,000 

1,330,000 

9448 

125 

140 

F-8J 

2,476,000 

1 ,859,000 

13817 

179 

134 

F-8K 

727,000 

317,000 

3597 

202 

88 

122 
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Table  17.  PERCENTAGE  DIFFERENCES  BETWEEN  DEPOT  COMPONENT 
MAINTENANCE  COSTS  (DCMC)  FOR  SIX  TMS  AIRCRAFT 
IN  THE  TSS  AND  MS  FOR  FY  75  DATA  (1976 
VAMOSC-AIR) 


TMS 

TSS  DCMC  as  a 
Percent  of  MS  DCMC 

F-4B 

146 

F-4J 

89 

F-4N 

117 

F-8H 

112 

F-8J 

75 

CO 

1 

u. 

43 

possible  confusion,  IDA  added  the  D for  "detail"  to  distinguish 
between  the  MS  summary  report  and  the  detailed  reports  that  are 
available  for  each  TMS  aircraft. 

The  cost  categories  on  the  first  data  page  in  the  MSD 
report  for  any  given  TMS  aircraft  are  identical  to  the  cate- 
gories presented  in  Table  1^  for  the  MS  report. 

The  next  data  format  presents  cost  categories  for  unsched- 
uled maintenance  actions  by  WUC,  and  these  categories  are  shown 
in  Table  l8. 

A summary  page  following  the  data  format  shown  in  Table  18 
contains 

(1)  Aircraft  totals  derived  by  summing  across  all  WUCs 
for.  the  categories  in  Table  18; 

(2)  percentage  contribution  of  each  cost  type  to  total 
costs ; 

(3)  percentage  contribtuion  to  each  cost  type  by  major 
subsystem  (airframe,  power  plant,  and  avionics); 

(^1)  maintenance  level  cost  summary  for  material  and 
labor  ($K); 

(5)  flight  hour  summary; 
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Table  18.  UNSCHEDULED  COMPONENT  MAINTENANCE 
COST  CATEGORIES  IN  THE  MSD  REPORT 


MATERIAL  COSTS  BY  MUC 

Material  cost  for  organltational  level  repairs 
Material  cost  for  intermediate  level  repairs 
Cost  of  intermediate  level  attritions 
Material  costs  of  depot  level  repairs 
(Depot-NARF,  Commercial) 

Cost  of  depot  level  surveys 

Total  material  cost  for  all  maintenance  levels 

DIRECT  LABOR  COST  BY  WUC 

Labor  costs  at  organizational  level 
(maintenance  hours) 

Labor  costs  at  intermediate  level 
(maintenance  hours) 

Labor  costs  at  depot  level 

(NARF  maintenance  hours.  Comm,  maint.  hours) 
Total  direct  labor  cost  for  all  maintenance 
levels 

TOTAL  COST  - SUM  OF  ALL  MATERIAL  AND  DIRECT  LABOR 
COSTS  FOR  EACH  WUC 

MAINTENANCE  COST  PER  FAILURE  BY  WUC 

MEAN  TIME  (FLIGHT  HOURS)  BETWEEN  FAILURES 

MEAN  TIME  (FLIGHT  HOURS)  BETWEEN  MAINTENANCE  ACTIONS 


(6)  cost  per  flight  hour  and  maintenance  actions  per 
flight  hour; 

(7)  cost  per  program  aircraft;  operating  aircraft. 

A similar  data  page  containing  the  cost  categories  in 
Table  18  is  in  the  MSD  report  for  scheduled  componente  mainte- 
nance actions,  and  it  is  followed  by  a similar  page  of  addi- 
tional summary  data  as  listed  in  items  1 through  7 above. 

The  next  data  format  in  the  MSD  report  is  the  Maintenance 
Action  Report,  and  it  contains  maintenance  frequency  data  broken 
down  by  type  of  maintenance  actions  and  WUC  for  unscheduled 
maintenance.  This  is  followed  by  a similar  Maintenance  Action 
Report  format  for  scheduled  maintenance. 

A component  manhour  report  is  the  next  data  format  in  the 
MSD  report,  and  it  summarizes  manhour  utilization  by  WUC. 


A total  material  cost  report  is  the  next  data  format,  and 
it  is  based  on  material  issue  data  from  a selected  group  of 
squadrons  known  to  have  good  reporting  practices.  It  is  used 
to  calculate  the  average  material  costs  presented  in  the  next 
data  format,  the  Average  Component  Cost  Report. 

The  Average  Component  Cost  Report  is  based  on  several  cost 
algorithms,  and  these  are  used  to  calculate  the  costs  per  action 
for  each  WUC.  For  each  WUC  on  the  TMS  aircraft  covered  by  a 
particular  MSD  report,  the  following  costs  per  action  are  cal- 
culated, as  shown  in  Table  19 . 

The  distinctive  characteristic  to  remember  about  the  sub- 
stantial detail  described  above  for  the  various  data  formats 
in  the  MSD  report  is  that  this  detail  is  available  for  approxi- 
mately 100  TMS  aircraft  in  the  Navy.  Thus,  the  same  22  pages 
of  data  formats  as  described  above  are  available  for  each  of 
the  100-plus  aircraft  TMS. 

Most  of  the  data  formats  discussed  in  the  MSD  report  pre- 
sentation above  are  available,  according  to  the  narrative  in 


Table  19.  AVERAGE  COST  REPORT  COST  CATEGORIES  IN  THE 
MSD  REPORT 


MATERIAL  COST  PER  ACTION  BASIS 

1 Consumable  material  cost  for  organizational  level  repairs 

Consumable  material  cost  for  intermediate  level  repairs 
Cost  of  intermediate  level  attritions 
Material  cost  of  NARF  repair 
Material  cost  of  commercial  repair 
Material  cost  of  depot  surveys 

« 

LABOR  (DEPOT  ONLY) 

Direct  labor  - NARF  repair 
Direct  labor  - Commercial  repair 
Indirect  labor  - NARF  repair 

* DIRECT  LABOR  RATE 
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the  MSD  report,  at  the  7-dlgit  WUC  level  through  NADC.  The 
2-digit  data  shown  in  the  regularly  recurring  MSD  report  are 
identified  as  summaries  of  the  7-digit  data.* 


e . The  Linkage  Between  Intermediate  afnd  Depot  Mainte- 
nance in  the  MS  and  MSD  Reports., 

The  real  sophistication  in  the  MS/and  MDS  systems  is  the 
linkage  between  intermediate  and  depot  maintenance.  It  is 
sophisticated  because  it  solves  the  problem  created  by  the 
absence  of  V/UCs  in  the  depot  level  maintenance  reporting.  WUCs 
are  used  at  the  organizational  and  intermediate  levels.  Figure  8 

shows  the  linkage.  / 

/ 

In  Step  1,  the  repairable  item  data  file  (RIDF)  maintained 
at  Maintenance  Support  Office  (MSO)^,  Mechanlcsburg,  PA,  records 
Beyond  Capability  of  Maintenance  (BCM)  items  from  the  inter- 
mediate level,  and  each  item  is  coded  by  WUC  and  part  number. 

In  Step  2,  the  M30  part  number  file  is  used  to  assign  each 
part-numbered  item  in  the  3M  RIDP  a National  Item  Identification 


^Ihe  exceptions  to  the  7-digit  availability  are  the  following: 

SL4:port  costs  (painting,  washing  A/C,  etc.)  reported  in  the  support 
action  file.  Support  costs  are  allocated  to  the  7th  WUC  digit  but  reported 
only  to  the  2nd  digit.  In  avionics  there  are  practically  no  si^jport  costs. 

Technical  Directive  Conpllance  (TDC)  actions  are  reported  only  by  2- 
dlglt  WUC.  Manhours  are  reported  and  some  materials.  Ihe  materials  cannot 
be  allocated  by  WUC.  The  costs  of  TDC  kits  are  not  in  the  VAMDSC  system 
because  these  are  not  reported  in  3M. 

Preexpendable  Costs  cover  nuts-  and  bolts-type  materials  (bench  stock). 
These  costs  are  not  separately  identified. 

*MSO  maintains  a depot  cost  library  file  to  be  used  in  developing  depot 
cost  data.  Data  in  the  file  comes  from  two  sources:  (1)  The  NARFs,  based 
on  their  production  files,  report  by  NIIN  the  nuirbers  of  items  repaired  and 
their  costs;  (2)  the  Aviation  Support  Office  in  Philadelphia  reviews  their 
contract  files  and  extracts  the  number  of  NIINs  worked  on  in  contract 
maintenance  and  cost  per  NIIN.  Costs  differ  between  organic  and  contract 
maintenance.  Often  it  is  not  possible  to  determine  whether  a given  BCM 
item  shown  by  WUC  will  be  repaired  in  organic  or  contract  facilities.  In 
these  Instances  NADC  uses  algorithms  based  on  historical  experience. 
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Number  (NIIN).  Since  each  part-numbered  Item  in  the  RIDF  has 
a WUC  identification,  the  items  are  now  identified  by  part  num- 
ber, NIIN,  and  WUC. 

In  Step  3,  the  NADC  depot  cost  library  assigns  repair 
costs  to  the  BCM  items  according  to  their  NIINs.  It  is 
according  to  NIINs  that  NARF  repairs  and  ASO  commercial  contract 
repairs  are  recorded. 

The  final  step  is  to  organize  the  data  into  the  NADC  MS 
report.  The  depot  cost  is  identifiable  to  WUCs  through  the 
WUC-Part-Number-NIIN  linkage. 

f . Relationship  Between  the  TSS  and  the  MS  and  MSP 
Systems 

The  NADC  MS  and  MSD  reports  provide  one  input  category  to 
the  TSS,  replacement  repairables,  which  is  made  up  of  two  cate- 
gories in  the  MS  report,  "attritions"  and  "surveyed  repairables. 
Attritions  occur  at  the  intermediate  level,  and  record  the 
replacement  value  of  normally  repairable  components  of  a given 
TMS  that  are  found  to  be  beyond  the  point  of  economical  repair. 
Attritions  are  based  on  the  actual  unit  replacement  cost  and 
fiscal  year  attrition,  not  on  actual  expenditure  since  all  items 
are  not  necessarily  replaced  within  the  fiscal  year. 

Survey  repairables  records  the  replacement  value  of  nor- 
mally repairable  components  that  are  found  to  be  beyond  the 
point  of  economical  repair  at  the  depot  level.  This  cost  is 
based  on  actual  repair/survey  rates.  A sample  of  the  data 
verifies  that  the  replacement  repairables  data  in  the  TSS  are 
consistent  with  the  attritions  and  surveys  in  the  MS  and  MSD 
reports.  A random  check  of  several  TMS  aicraft  verifies  that 
Intermediate  "attritions"  (A)  and  depot  "surveyed  repairables" 
(S)  are  added  together  and  reported  from  the  MS  to  the  TSS,  and 
recorded  in  the  TSS  as  "replacement  repairables"  (RR).  Data 
are  taken  from  the  1976  reports  and  displayed  in  Table  20. 


Table  20.  A COMPARISON  OF  THE  COST  OF  REPLACEMENT 
REPAIRABLES  IN  THE  TSS  WITH  ATTRITIONS 
AND  SURVEYED  REPAIRABLES  IN  THE  MS 
BASED  ON  FY  75  DATA  FROM  1976 
VAMOSC-AIR  FOR  9 TMS 


TMS 

RR  From  TSS* 

Taken  from 

MS 

A* 

S* 

A+S* 

F-4B 

$ 636 

$ 249 

$ 388 

$ 637 

RF-4B 

185 

84 

102 

186 

F.4J 

2780 

1084 

1697 

2781 

F-4N 

2686 

2078 

609 

2687 

RF-8G 

203 

77 

127 

204 

F-8H 

187 

12 

176 

188 

F-8J 

522 

141 

382 

523 

F-8K 

243 

157 

87 

244 

F-14A 

686 

278 

409 

687 

♦Data  in  thousands  of  dollars. 


It  seems  clear  that  the  Navy  VAMOSC  maintenance  subsystem 
provides  potential  data  coverage  at  the  WUC  level  to  permit 
cost  analyses  techniques  at  detailed  avionics  equipment  levels 
to  be  pursued. 

5 . Summary 

This  section  reviewed  the  Navy  support  cost  estimating 
methodologies  that  are  currently  utilized  for  component  esti- 
mates. The  P-18  Internal  NAVAIR  tracking  model  takes  total 
weapon  system  replenishment  spares  (regression  estimates)  and 
allocated  them  to  2-dlglt  WUCs  based  on  F-M  experience.  Although 
this  is  currently  used  only  to  estimate  a component  level  base- 
line after  DSARC  II  for  each  2-dlglt  WUC,  it  could  be  used  as 
an  initial  cost  estimate. 
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other  Navy  models  could  be  employed  at  the  component  level 
early  in  a program's  acquisition  cycle  by  the  use  of  analogy 
data,  as  suggested  earlier  for  several  Air  Force  models. 

The  Navy  data  systems  are  organized  through  the  NALCOMIS 
VAMOSC  data  management  systems  to  provide  detailed  2-  and  7-digit 
WUC  support  cost  data.  The  VAMOSC  Maintenance  Subsystem  has 
successfully  linked  organizational  and  intermediate  maintenance 
data  with  depot  maintenance  data  through  a WUC-NIIN  Interface. 

D.  SUMMARY 

Support  cost  estimating  methodologies,  policies,  and  data 
systems  are  fundamentally  similar  in  the  Air  Force  and  the 
Navy,  but  they  differ  in  the  emphasis  they  receive  and  the  uses 
to  which  they  are  put. 

Both  Services  have  accounting  component  support  cost  models, 
but  the  Air  Force  Logistics  Command  Logistic  Support  Cost  (LSC) 
model  is  more  extensively  developed  ar i applied  than  the  Navy 
Material  Command  Equipment  Life  Cycle  Cost  model.  Both  Services 
have  parametric  regression  support  cost  models,  but  the  equations 
developed  through  the  Naval  Air  Systems  Command  are  more  exten- 
sively developed  and  applied  than  the  regression  equations  in 
the  Air  Force  CACE  model.  The  CAGE  model  relies  primarily  on 
historical  factors. 

The  data  systems  available  to  both  Services  report  costs 
for  maintenance  at  all  levels  and  spares  and  repair  parts  sup- 
port, as  well  as  other  support  costs.  However,  the  integration 
of  the  data  outputs  of  these  systems  into  consistent,  unified 
support  cost  data  bases  for  each  Service  is  currently  at  a 
different  stage  of  development  in  each  Service.  The  Air  Force 
OSCER  system  is  currently  reporting  support  cost  data  at  the 
weapon  system  level  but  not  at  the  component  level.  The  Navy 
NALCOMIS  Maintenance  Subsystem  has  produced  two-digit  WUC  com- 
ponent support  cost  data  for  Fiscal  Years  1975  and  1976,  and 
the  1977  report  is  in  process. 
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Chapter  III 


CONTRACTOR  COST 
FIGHTER 


ESTIMATING  METHODOLOGIES  FOR 
AIRCRAFT  AVIONICS 


A.  INTRODUCTION 

Commercial  defense  contractors  are  interested  in  avionics 
support  cost  estimating  methodologies  because  support  costs  are 
explicitly  identified  in  DoD  acquisition  policy  documents  as 
major  decision  items,'  and  because  avionics  equipments  account 
for  large  shares  of  the  support  costs  generated  by  fighter  air- 
craft.^ Statements  made  by  contractors,  OSD  officials,  and  Air 
Force  and  Navy  personnel  all  confirm  the  high  interest  priorities 
that  each  of  these  groups  places  on  avionics  cost  estimates  for 
proposed  aircraft  weapon  systems,  estimates  which  can  provide 


'DoDD  5000.1,  January  l8,  1977,  Major  System  Acquisitions;  DoDD  5000.2, 
January  18,  1977>  Major  System  Acquisition  Process;  DoDD  5000.28',  May  23, 
1975,  Design  to  Cost;  DoDD  4105.62,  January  6,  1976,  (amended  March  3, 
1977),  Selection  of  Contractual  Sources  for  Major  Defense  Systems.  DoDD 
4105.62  specifically  requires  that  the  source  selection  plan  prepared  by 
the  Involved  Service  will  include  guidelines  for  making  trade-offs  among 
and  between  performance  characteristics  of  the  proposed  systems  and  their 
development,  production,  and  operating  and  support  costs,  as  well  as  the 
delivery  schedule  and  quantity  of  the  proposed  systems  and  any  applicable 
qualitative  requirements.  This  early  specification  of  guidelines  for 
trade-offs  between  performance  characteristics  and  costs,  including  O&S 
costs,  requires  the  contractors  to  explicitly  explore  the  quantitative 
functional  relationships  between  performance  characteristics  and  O&S  costs, 
and  these  explorations  are  eirtoodled  in  alternative  methodological  approaches 
to  avionics  support  cost  estimates. 

^Avionics  component  maintenance  costs  for  fiscal  year  1975  for  13  attack  and 
7 filter  IMS  aircraft  in  the  Navy  averaged  4l  percent  of  total  conponent 
maintenance  costs.  The  low  was  25  percent  for  the  F-8K,  and  the  high  was 
62  percent  for  the  A-6B.  Avionics  as  defined  here  Includes  eqiilpment  in 
WUCs  51  throu^  76  inclusive.  Data  are  from  the  NALCOMIS-OSS  (VAMOSC-AIR) 
Maintenance  Subsystem  Report,  December  31,  1976. 
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objective  bases  for  programs  to  promote  avionics  cost  control 
and  effectiveness.^ 

The  entire  range  of  support  cost  estimating  methodologies 
is  available  to  avionics  equipment  and  prime  aircraft  weapon 
system  contractors,  including  the  six  major  methodological 
approaches  listed  below  and  discussed  later: 

(1)  Engineering  bottoms-up 

(2)  Analogy  with  existing  systems 

(3)  Accounting  add-up 

(^)  Simulation 

(5)  Parametric  regression 

(6)  Subjective  expert  Judgment. 

Although  all  of  these  methodological  approaches  are  used  by  con- 
tractors to  estimate  support  costs,  IDA  discussions  with  several 
of  the  contractors  Indicate  that  early  conceptual  stage  (pre- 
DSARC  I milestone  decision)  support  cost  estimates  are  most 
frequently  made  through  the  application  of  engineering  and 
analogy  approaches;  the  validation  and  demonstration  stage  (post- 
DSARC  I,  pre-DSARC  II)  estimates  are  usually  accomplished  through 
engineering  and  analogy  approaches  with  some  utilization  of 
accounting  and  parametric  approaches:  and  the  full  scale  develop- 
ment stage  (post-DSARC  II,  pre-DSARC  III)  estimates  may  employ 
al]  six  of  the  approaches  mentioned  above,  but  with  increasing 
reliance  on  bottoms-up  and  accounting  approaches  that  use  real 
world  test  data  on  prototype  systems  as  the  data  become  available. 


*J.P.  Dlgby,  DoD  Actions  to  Control  Avionics  Life-Cycle  Costs  y RAND  Vforking 
Note  823^-ARPA,  The  RAND  Corporation,  Santa  Monica,  CA,  May  1973;  D.J. 
Dreyfus,  A Survey  of  Costing  Methods  in  the  Avionics  Inudstry^  RAND  Working 
Note  8235-ARPA,  May  1973;  C.  David  Welmer,  The  Application  of  Design-to-Cost 
Acquisition  Policies  to  Selected  Electronic  Subsystem  Development  Programs y 
IDA  S-i*59»  Institute  for  Defense  Analyses,  Arlington,  VA,  June  1975;  E.N. 
Dodson  et  al..  Cost  Analysis  of  Avionics  Equipment,  Report  73-^^l»  General 
Research  Corporation,  McLean,  VA,  February  1974;  l^or  Fiichard  W.  Grinin, 

Fire  Control  Radar  and  Airborne  Computer  Cost  Prediction  Based  on  Technical 
Parameters,  V/rlght-Patterson  AFB,  Ohio,  Air  Force  Avionics  Laboratory, 
Septerrber  1973- 
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Major  perspectives  assessed  In  the  discussions  to  follow 
include  the  following: 

(1)  Two  categories  of  contractors  should  be  dis- 
tinguished, avionics  equipment-producing  firms 
like  Hughes,  Rockwell-Autonetics , and  Westing- 
house;  and  avionics  equipment-using  firms  like 
Grumman,  McDonnell  Douglas,  General  Dynamics, 
and  Northrop. 

(2)  Various  contractor  cost  estimating  processes 
interact  throughout  the  conceptual  and  valida- 
tion stages  leading  to  source  selection  and 
the  DSARC  II  milestone,  and  as  a result  the 
engineering  expertise  of  equipment-producing 
contractors  can  be  included  in  the  accounting 
build-up  approaches  of  prime  contractors; 

(3)  Contractors  are  capable  of  providing  detailed 
avionics  equipment  support  cost  estimates 
earlier  in  the  acquisition  process  than  they 
are  formally  required  to  provide  by  DOD  policies 
and  regulations; 

(4)  Several  cost  estimating  model  building  efforts 
are  underway  to  broaden  the  generality  and 
applicability  of  support  cost  estimating 
techniques ; 

(5)  Contractor  support  cost  data  bases  rely  heavily 
on  the  data  provided  through  the  Air  Force  and 
Navy  data  systems  discussed  in  Chapter  II.  Each 
firm  usually  receives  data  related  only  to  its 
own  systems  and  equipments;  however,  a firm  can 
receive  data  on  other  firms'  systems  and  equip- 
ments if  it  is  awarded  study  contracts  that 
require  such  other-firm  data.  The  Grumman  Aero- 
space Coporation  contract  with  the  Air  Force 
Flight  Dynamics  Laboratory,'  and  the  Westing- 
house  Electric  Corporation  contract  with  the 


'The  Grunran  contract  is  being  pursued  with  the  LocWieed-Georgla  Conpany, 
Modular  Life  Cycle  Cost  Model  for  Advanced  Aircraft  System^  Contract 
No.  F33615-76-C-3056.  As  an  exanple  of  data  acquisition,  Grumman-Lockheed 
received  logistics  and  deslgi  data  for  the  following  aircraft:  A-3D, 

A-4D,  A-5A,  A-6E,  EA-6B,  F-4B,  F-8U,  F-14A,  F-llOA,  F-102A,  P-104C,  F-IO6B, 
C-133A,  KC-135A,  C-I3OA,  C-2A,  C-5A,  B-47B,  B-52D,  B-58,  RB-66B,  E-2A, 

T-38,  T-39  (third  oral  briefing  to  Air  Force,  June  22,  1977). 
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Air  Force  Avionics  Laboratory,*  are  examples 
of  contractor  access  through  study  contracts 
to  Service  data  on  the  avionics  equipments  of 
other  firms. 

(6)  Airframe  contractors  have  well-developed 

avionics  engineering  capabilities  which  permit 
them  to  prepare  avionics  equipment  bench  ver- 
sions of  proposed  avionics  equipment  on  new 
P-X  aircraft.  These  capabilities  enable  the 
airframe  contractors  to  specify  quite  precisely 
the  avionics  equipments  they  wish  avionics 
equipment  producers  to  bid  on.  The  important 
Ingredients  that  the  airframe  contractors  lack 
is  production  experience  in  large  quantltltes 
for  avionics  equipments,  and  reliability  and 
maintainability  parameter  estimation  in  the 
conceptual  stages  of  avionics  equipments. 

Cost  estimating  methodologies  are  varied  and  well-developed, 
but  their  full  potentials  for  providing  avionics  equipment  sup- 
port costs  to  the  Services  and  OSD  before  DSARC  II  are  not  fully 
exercised  in  the  form  of  avionics  support  cost  estimates  required 
by  and  presented  to  OSD  and  the  Services. 


B.  THE  CONTRACTOR  COST  ESTIMATING  PROCESS 

Two  major  categories  of  contractors  are  identified  as  par- 
ticipants in  the  avionics  support  cost  estimating  process 
depicted  in  Table  21.  The  avionics  equipment-producing  firms 
like  Hughes  and  Westinghouse  actually  manufacture  avionics 
equipments  while  the  avionics  equipment-using  firms  like 
McDonnell  Douglas  and  Grumman  are  prime  weapon  system  contrac- 
tors that  purchase  (through  sub-contracting)  avionics  equipment 
from  the  producing  firms. ^ Both  of  these  categories  of  contrac- 
tors are  called  upon,  by  each  other  and  by  DoD,  to  estimate 
avionics  support  costs  during  the  acquisition  process. 

^Predictive  Operatione  and  Maintenance  Cost  Models  Statement  of  Woric  Pur- 
chase request  nuirfcer  FY11757720318,  Westin^iouse  Electric  Corporation,  1977. 

^Ihls  distinction  is  similar  to  that  made  in  D.J.  Dreyfuss,  A Survey  of 
Costing  Methods  in  the  Avionics  Inudstry,  RAND  Working  Note  WN-8235-ARPA, 
Santa  Monica,  CA,  The  RAND  Corporation,  May  1973  (continued  on  page  136) 
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Table  21.  COMMON  SEQUENCE  OF  CONTRACTOR  AVIONICS 

SUPPORT  COST  ESTIMATING  PROCEDURES  DURING 
CONCEPTUAL  AND  VALIDATION  STAGES 


Step 

Type  Firm 

Cost  Estimating  Activity 

1 

Aircraft  Prime  Contractor 

Uses  analogy  or  parametric 
regressions  to  estimate  avion- 
ics support  costs  as  a single 
lump,  not  broken  out  by  pieces 
of  equipment. 

2 

Aircraft  Prime  Contractor 

Requests  acquisition  and 
support  cost  estimates  and 
support  parameters  such  as 

MTBF  for  types  of  equipment 
from  avionics  producers. 

3 

Avionics  Equipment 

Producer 

Engineering  bottoms-up  or 
analogy  estimates  of  acquisi- 
tion and  support  costs  and 
support  parameters  such  as 

MTBF  for  specific  equipments, 
reported  to  prime  contractor. 

4 

Aircraft  Prime  Contractor 

Uses  accounting  build-up  or 
parametric  estimates  with 
avionics  equipment  producers 
estimates  and  support  param- 
eters as  inputs. 

5 

Avionics  Equipment 

Producer 

Uses  aircraft  prime  contractor 
total  aircraft  weapon  system 
estimates  as  inputs  to  modify 
analogy  and  engineering  esti- 
mates, reports  up-dated  esti- 
mates to  aircraft  prime 
contractor . 

6 

Both  Avionics  Equipment 
Producer  and  Aircraft 

Prime  Contractor 

Continue  to  iterate  cost  models 
by  inputting  each  other's  up- 
dated data  and  reporting 
iterations  to  each  other.  In 
this  process,  all  cost  esti- 
mating methodologies  may  inter- 
act through  iterative  processes. 
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As  shown  In  Table  21,  the  equipment-producing  contractors 
rely  heavily  on  engineering  and  analogy  approaches  early  in  the 
acquisition  process,  while  the  equipment-using  prime  contractors 
rely  heavily  on  accounting  and  parametric  approaches  in  addition 
to  analogy.  The  sequence  of  avionics  support  cost  estimating 
procedures  shown  in  Table  21  displays  the  interactive  nature  of 
contractor  cost  estimating.  With  the  full  range  of  cost  esti- 
mating methodologies  available,  the  prime  contractor . in  step 
one  of  the  table  relies  on  analogy  to  existing  systems  or  param- 
etric regression  equations  to  estimate  avionics  support  costs 
early  in  the  conceptual  phase  between  DSARC  0 and  DSARC  I.  At 
this  point,  the  potential  prime  contractor  is  only  interested 
in  gross  aggregate  cost  estimates  for  avionics  equipment  as  a 
single  total.  Although  the  prime  contractor  may  have  sufficient 
engineering  expertise  to  do  a bottoms-up  estimate  for  avionics 
at  the  level  of  each  piece  of  avionics  equipment,  it  is  most 
likely  that  a factor  will  be  applied  to  the  acquisition  cost 
estimate  for  the  proposed  weapon  system  to  derive  a rough  rule- 
of-thumb  aggregate  estimate  for  total  life  cycle  support  costs. 
This  aggregate  factored  estimate  may  be  broken  down  to  separate 
factored  estimates  for  avionics,  airframe,  and  propulsion,  as 
shown  in  alternative  one  in  Figure  9.  This  initial  support  cost 
estimate  is  purely  a function  of  historical  experience  with 
prior  weapon  systems  produced  by  the  contractor  and  the  new 


(contd) . . .Dreyfuss  surveyed  10  firms  called  "contractors,"  and  divided  them 
into  three  categories:  avionics  producers;  avionics  users/developers;  and 
research  flnns.  Our  survey  of  si^^port  cost  methodology  does  not  include 
the  research  firms  category.  The  distinction  between  avionics  equipment 
producers  and  aircraft  prime  contractor  avionic  equipment  purchasers  or 
users  is  also  consistent  with  the  usage  of  similar  distinctions  in  H.P. 
Gates  et  at.,  Eteotvonics-X:  A Study  of  Military  Eteatvonios  with  Particu- 
lar Reference  to  Cost  and  Reliability,  IDA  Report  R-1975,  Arlington,  VA, 
Institute  for  Defense  Analyses,  January  197^,  and  C.D.  Welmer,  Applica- 
tion of  Design- to- Cost  Acquisition  Policies  to  Selected  Electronics  Sub- 
system Development  Programs,  IDA  Study  S-'459j  Arlington,  VA,  Institute  for 
Defense  Analyses,  June  1975* 


ALTERNATIVE  1,  HISTORICAL  ANALOGY  FACTORS 


C|  = + C^2  ^13 

Where  C^  = Total  weapon  system  support  costs 

^11  " ^11 

^12  " ^12  ^12 

^13  " ^13  ^^13 

C^^  = Avionics  support  cost 

Ci2  = Airframe  support  cost 

C|3  = Propulsion  support  cost 

Z,,,  Z,2.  Z,,  = Factors  developed  from  historical 
experience  on  analogous  weapon 
systems 

X,,  = Avionics  acquisition  cost  or  total  weapon 
system  acquisition  cost 

X,2  = Airframe  acquisition  cost  or  total  weapon 
system  acquisition  cost 

X - = Propulsion  acquisition  cost  or  total  weapon 
system  acquisition  cost 


ALTERNATIVE  2,  PARAMETRIC  REGRESSION 
C^  = a + S^X^  + $2X2 
Where  C-j  = Avionics  support  cost 

a = Constant  term  representing  avionics  support 

cost  that  is  independent  of  weapon  system,  i.e., 
storage  and  disposal  costs 

6's  = Regression  coefficients  which  quantify  the  re- 
lationships between  the  cost  (C,)  and  the 
independent  variables 

X's  = Independent  variables  such  as  total  weapon 

system  acquisition  cost  or  avionics  acquisi- 
tion cost 


Figure  9.  PRIME  CONTRACTOR  AVIONICS  SUPPORT  COST 
ESTIMATES  DURING  CONCEPTUAL  STAGE 
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proposed  weapon  system's  acquisition  cost  estimate,  which  itself 
may  be  a factored  result  of  historical  experience  with  analogous 
systems  or  a parametric  regression  output.  Thus,  the  step  one 
avionics  support  cost  estimating  process  in  Table  21  frequently 
follows  the  procedure  outlined  in  Figure  9 for  alternative  one. 

A variation  of  the  historical  analogy  factor  technique  is 
to  replace  the  Z factors  with  Z-prlme  (Z')  factors  that  repre- 
sent historical  factors  modified  by  subjective  expert  judgments 
about  the  differences  between  analogous  systems  and  the  new 
proposed  system.  The  Z'  judgment-modified  factors  are  not  shown 
in  Figure  9,  but  would  simply  replace  the  Z factors  in  the 
equations . 

Alternative  two  in  Figure  9 is  a parametric  regression 
approach,  which  amounts  to  a formal  statistically  quantified 
version  of  the  analogy  factor  approach.  Here,  historical  data 
for  existing  avionics  systems'  support  costs  (C^)  are  processed 
through  regression  techniques  with  data  for  the  existing  systems' 
acquisition  costs  (either  total  weapon  systems  acquisition  costs 
or  avionics  system  acquisition  costs).  The  result  is  a set  of 
beta  coefficients  (6's)  that  generate  the  new  proposed  system's 
avionics  support  costs  when  values  for  the  new  system's  acqui- 
tion  costs  are  entered  in  the  equation.  The  3-coefficients  are 
like  the  Z-f actors  in  the  analogy  technique,  but  with  the  added 
feature  of  statistical  properties  that  can  be  measured  to  ascer- 
tain the  certainty  with  which  we  should  accept  the  3's  as 
representative  of  the  real  relationship  between  avionics  support 
costs  and  acquisition  costs. 

Thus,  avionics  support  cost  estimates  during  the  conceptual 
phase  are  functionally  related  to  acquisition  cost  estimates, 
both  in  the  analogy  approach  and  in  the  regression  aprroach  used 
by  prime  weapon  systems  contractors.  If  support  costs  are 
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reported  for  the  DSARC  I milestone  decision, ^ they  are  reported 
at  an  aggregate  level  for  the  entire  weapon  system,  or  for  the 
aggregate  avionics,  airframe,  and  propulsion  breakdown  of  the 
total  system.  If  they  are  not  reported,  they  are  still  useful 
for  internal  firm  assessments  of  the  magnitude  of  support  costs 
for  the  proposed  program. 

Step  two  in  Table  21  shows  the  weapon  system  prime  contrac- 
tor requesting  acquisition  and  support  cost  estimates  and  logis- 
tic characteristics  like  MTBF  from  avionics  equipment  producers. 

In  step  three,  the  equipment-producers  utilize  their  engineering 
expertise  to  perform  bottoms-up  or  analogy  estimates  of  acquisi- 
tion and  support  costs  and  support  parameters.  These  estimates 
are  reported  to  the  prime  contractor,  and  in  turn  they  are 
incorporated  into  the  prime  contractor's  analogy  model  or  regres- 
sion equation?.  In  this  manner,  the  engineering  expertise  of 
the  avionics  equipment  producers  becomes  the  source  of  independent 
variables  in  the  analogy  and  regression  equations  exercised  by 
the  prime  contractors.  These  equipment-producer  engineering 
estimates  may  be  incorporated  into  formal  prime  contractor 
presentations  for  the  DSARC  I decision,  and  the  prime  contractor 
begins  to  use  accounting  build-up  models  to  estimate  avionics 
equipment  support  costs,  as  shown  in  step  four  in  Table  21. 

These  accounting  models  may  still  be  heavily  dependent  on 
engineering  bottoms-up  estimates  from  the  equipment-producers. 

In  step  five  of  Table  21,  the  avionics  equipment  producers  use 
the  prime  contractor  acquisition  and  support  cost  estimates  to 
modify  their  engineering  or  analogy  estimates  and  these  modified 
estimates  are  then  reported  to  the  prime  contractor  where  they 
are  Incorporated  into  the  prime  contractor's  estimates.  This 
process  continues  throughout  the  validation  stage  and  up  to  and 


*The  DSARC-I  decision  is  approval  to  proceed  with  the  validation  phase, 
culminating  in  a Service  source  selection  decision,  which  is  in  turn  quickly 
followed  by  a DSARC-II  milestone  decision  approving  or  denying  the  full 
scale  development  phase. 
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including  the  equipment-level  support  cost  estimates  reported 
to  the  Service  selection  authority  for  the  source  selection 
decision . 

Once  beyond  DSARC  II,  the  contractors  and  the  Services 
acquire  prototype  equipments  which  are  tested  for  support 
characteristics.  The  test  data  are  then  entered  into  accounting 
and  engineering  equations  to  provide  more  realistic  cost  esti- 
mates . 

The  most  important  message  of  Table  21  is  that  the  contrac- 
tor cost  estimating  process  for  avionics  support  costs  is  not 
a single  process  but  is  Instead  made  up  of  several  different 
processes  represented  by  different  cost  estimating  methodologies 
which  Interact.  These  interactive  Iterative  processes  are  the 
dominant  characteristics  of  contractor  avionics  support  cost 
estimating.  The  implication  to  be  extracted  from  Table  21  is 
that  although  engineering  bottoms-up  approaches  are  most  fre- 
quently utilized  directly  by  the  avionics  equipment  producers, 
the  aircraft  prime  contractors  enjoy  the  fruits  of  these  exercises 
when  the  engineering  approach  estimates  are  included  as  Inputs 
into  the  accounting  or  parametric  approaches  most  frequently 
used  by  the  prime  contractors.  Similarly,  the  accounting  build- 
up or  parametric  approaches  used  by  the  prime  contractors  react 
back  on  the  avionics  equipment  producers  and  further  refine  their 
data  inputs.  Contractor  avionics  support  cost  estimates  are  not 
produced  in  a vacuum  where  the  engineering  expertise  of  the 
equipment  producers  is  denied  to  the  prime  contractors,  nor  where 
fhe  total  weapon  system  perspective  and  Integration  expertise 
ho  prime  contractors  is  denied  to  the  equipment  producers. 

' contractors  practice  to  a significant  degree  what  the 
"vlo  - urrertly  lack,  an  Integrated  methodological 
’ --  •support  cost  estimating. 

r*  estimating  has  been  encouraged  by 

' • - r’  ^ ipport  costs  explicitly  in 


acquisition  decisions.  Interpreted  in  terms  of  these  policies, 
it  is  possible  to  simply  state  that  the  contractors  are  willing 
to  do  whatever  the  government  requires  in  order  to  participate 
successfully  in  the  acquisition  process.  Most  of  the  contrac- 
tors IDA  interviewed  indicated  that  they  used  the  APLC  LSC 
accounting  model  or  the  NAVMAT  LCC  accounting  model  to  report 
avionics  equipment  level  support  costs  to  the  Services.  But 
reporting  costs  to  the  Services  is  not  necessarily  synonymous 
with  contractor  avionics  support  cost  estimating  methodology. 

In  fact,  the  utilization  of  Service-developed  accounting  models 
like  AFLC  LSC  and  NAVMAT  LCC  are  made  in  addition  to  and  fre- 
quently simultaneous  with  or  after  the  exercising  of  the  pro- 
cesses detailed  in  Table  21.  To  a degree,  the  Service  account- 
ing models  enter  the  Iterative  processes  and  become  part  of  the 
whole.  But  it  is  also  true  that  the  analogy,  engineering, 
parametric,  and  other  approaches  are  frequently  exercised 
Independent  of  the  Service  accounting  models.  Thus,  contractor 
support  cost-estimating  methodology  exists  Independent  of  the 
Service  models,  although  by  the  nature  of  the  source  selection 
process  that  specifies  models  for  contractor  use,  the  contrac- 
tor methodology  and  the  Service  methodology  Interact  and  Join 
as  phases  in  the  overall  contractor  estimating  process. 

A proper  understanding  of  the  sequential  flow  of  estimating 
procedures  in  Table  21  relates  to  the  issue  of  what  the  contrac- 
tors are  capable  of  providing  versus  what  they  have  chosen  to 
provide  in  response  to  DoD  policies  and  requirements.  The 
contractors  IDA  spoke  with  all  agreed  that  they  are  capable  of 
providing  avionics  equipment  support  cost  estimates  at  the  two- 
digit  WUC  level  (or  even  lower)  early  in  the  coneptual  stage 
before  DSARC  I.  Such  estimates  would  be  based  on  analogy  to 
similar  existing  systems  with  engineering  expert  Judgments 
adjusting  key  logistic  parameters  to  represent  desired, 
expected,  or  required  performance  characteristics  of  the  pro- 
posed new  systems. 


The  interviewed  contractors  repeatedly  expressed  two 
misgivings  about  such  early  equipment-level  O&S  estimates. 
First,  they  doubted  the  utility  of  these  early  estimates  for 
either  the  military  Services  or  OSD.  Their  doubts  were  not 
grounded  in  a refusal  to  accept  the  potentials  for  making 
comparisons  among  alternative  system  designs  during  the  con- 
ceptual stage  of  the  acquisition  process;  they  were  all  fully 
aware  that  more  detailed  information  provided  early,  in  the 
process  could  permit  the  Services  and  OSD  to  focus  on  narrower 
issues  of  design  and  performance  characteristics  versus  costs. 
They  all  also  agreed  with  the  conventional  wisdom  that  more 
than  half  of  total  life  cycle  support  costs  are  determined  by 
decisions  made  prior  to  the  DSARC  II  milestone,  so  their 
skepticism  about  the  usefulness  of  early  equipment  support 
cost  estimates  that  could  permit  performance  and  design  versus 
cost  trade-offs  was  even  more  surprising.  Granting  all  of 
these  potentials  of  early  equipment  support  cost  estimates, 
the  contractors  simply  do  not  appear  to  believe  that  OSD  is 
serious  about  making  acquisition  decisions  based  on  life  cycle 
costs  including  support  costs.  In  their  views,  a contractor 
proposal  offered  for  source  selection  that  carries  high  acqui- 
sition costs  but  low  life  cycle  costs  relative  to  another 
proposal  is  doomed  to  rejection  by  the  Service's  source  selec- 
tion authority.  Seen  in  this  light,  contractor  capabilities 
to  provide  early  estimates  of  support  costs  at  the  avionics 
equipment  level  are  unimportant  to  the  competitive  success  of 
the  companies. 

A second  contractor  misgiving  about  early  conceptual  stage 
equipment  support  cost  estimates  is  that  these  will  become  hard 
numbers  that  the  contractors  will  be  expected  to  adhere  to  by 
the  Services  and  OSD.  The  contractors  resist  being  tied  to 
numbers  developed  early  in  the  acquisition  process. 

Before  investigating  specific  examples  of  contractor  cost 
estimating  methods,  we  examine  next  the  policies  that  provide 
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the  impetus  for  avionics  support  cost  estimating  and  define 
the  Interfaces  between  contractor  estimating  methods  and  the 
Service  methods. 

C.  POLICIES  AND  PROCEDURES 

The  DoD  policies  and  procedures  that  Influence  contractor 
support  cost  estimates  are  those  that  define  the  major  weapon 
system  acquisition  process.  The  applicable  directives  that 
define  these  policies  and  processes  were  discussed  earlier  in 
Chapter  I. 

The  "general  policy"  section  of  DoDD  4105.62  was  amended 
in  March  1977  to  require  special  emphasis  on  the  promotion  of 
competition  in  the  selection  of  contractual  sources  for  major 
defense  acquisitions.'  To  this  end,  the  directive  requires 
that  the  pro  forma  nurturing  of  competition  should  be  supple- 
mented by  "...certain  additional  factors  which  more  appro- 
priately must  be  considered  when  the  selection  of  a source  is 
to  be  made  from  among  alternative  system  design  concepts."  One 
additional  factor  is  the  broadening  of  the  commercial  base 
from  which  proposals  are  to  be  initially  solicited,  and  a 
second  additional  factor  explicitly  identifies  trade-offs 
between  system  performance  characteristics  and  mission  need, 
schedule,  capability  objectives,  and  operating  constraints. 

The  language  of  this  directive  makes  it  clear  that  the  relation- 
ships between  performance  characteristics  and  support  costs  are 
to  be  explicitly  considered  and  incorporated  into  source  selec- 
tion documentation  and  decisions. 


'Change  1,  March  3,  1976,  Section  III. A. 2,;  "The  selection  of  contractual 
sources  may  be  either  as  a result  of  a conpetltion  among  alternative  sys- 
tem desiffi  concepts  or  as  a result  of  a more  restrictive  conpetltion  where 
the  system  has  previously  been  defined. . .the  solicitation  should  be  so 
structured  so  as  to  reflect  the  mission  need,  schedule,  cost,  capability 
objectives,  and  operating  constraints  but  not  technical  approach  or  naln 
deslgo  features." 


The  directive  also  includes  new  language  which  indlciates 
that  main  design  features  are  not  to  be  identified  by  the 
government  in  the  solicitation  documents  but  these  features 
should  be  identified  in  the  contractor  proposals.  This  expli- 
clcly  recognizes  considerable  flexibility  in  the  specific 
design  features  that  are  promoted  by  each  contractor,  and 
includes  flexibility  in  support  cost  techniques  which  relate 
to  a particular  design.  But  this  flexibility  in  support  cost 
techniques  is  reduced  by  the  likelihood  that  the  Service  will 
specify  a particular  equipment-level  support  cost  model  to  be 
used  for  the  contractor's  source  selection  submissions. 

The  source  selection  process  as  part  of  the  larger  weapon 
system  acquisition  process  has  been  carefully  detailed  in  other 
surveys  and  reviews,  and  the  latest  military  Service  interpre- 
tations of  specific  relationships  can  be  found  in  documents  like 
the  AFSC/AFLC  Life  Cycle  Cost  Procurement  Guide.*  Even  in  light 
of  directives,  guides,  and  other  official  documentation,  IDA 
discussions  with  avionics  equipment-producing  and  equipment-using 
contractors  suggest  that  considerable  additional  discipline  needs 
to  be  Introduced  into  the  cost  estimating  processes  followed  by 
DoD  and  the  private  contractors.  The  contractors  suggest  that 
additional  requirements  and  specifications  of  weapon  system 
performance  characteristics  and  logistic  characteristics  early 
in  the  conceptual  stage  could  improve  contractor  cost  estimates. 
These  ideas  are  echoed  in  a report  prepared  by  the  National 
Security  Industrial  Association,  a group  composed  of  contractor 
life  cycle  and  support  cost  experts.* 

*J.E.  Keman,  Jr.,  and  L.J.  Menker,  Life  Cycle  Cost  Procurement  Guide, 
Wrl^t-Patterson  AFB,  Ohio,  Joint  AFSC/AFLC  Coirmander's  Woricing  Groi?)  on 
Life-Cycle  Cost,  July  1976.  This  guide  contains  a major  section  devoted 
to  the  source  selection  process  and  is  directed  at  the  validation  and  full 
scale  development  phases  of  the  acquisition  process. 

*D.  Earles  and  H.I.  Starr,  Life  Cycle  Cost,  Findings,  and  Recommendations, 
Logistics  Management  Advisory  Conmlttee  of  the  National  Security  Indus- 
trial Association,  Apid.1  1976.  "The  Comnittee  (continued  on  page  145) 


Generally,  the  lack-of-discipline  complaint  Is  grounded 
In  the  argument  that  the  contractors  are  not  given  sufficient 
information  about  new  proposed  systems  early  enough  in  the 
acquisition  process.  The  NSIA  recommendation  is  for  DoD  to 
provide  increased  detail  concerning  cost  goals  and  requirements 
early  in  the  conceptual  stage. 

Another  NSIA  recommendation  made  to  DoD  is  that  life  cycle 
cost  estimates,  including  support  costs,  be  estimated  and 
reported  in  a continuous  process  throughout  the  acquisition 
cycle  and  not  Just  at  one  or  two  key  points  in  the  cycle. 

A third  recommendation  is  that  support  cost  estimates  be 
made  at  the  replaceable  equipment  level  since  estimates  are 
already  being  made  internally  by  contractors  at  this  level  in 
order  to  acquire  visibility  into  support  concept  differences 
early  in  the  conceptual  stage  of  the  acquisition  process. 

The  IDA  summary  view  of  contractor  policies  concerning 
support  cost  estimating  methodologies  is  that  whatever  level 
of  detail  the  government  requests  will  be  provided,  but  that 
in  the  contractors'  views,  the  government  does  not  ask  for 


(cont 'd) .. .objective  to  have  the  life  cycle  cost  of  a system  managed 
throughout  its  development,  production,  and  operational  use.  This  requires 
that  it  (LCC)  be  specified,  designed  to,  monitored,  tested  ajid  evaluated. 
Except  in  a few  recent  cases,  this  is  not  happening.  On  many  proprams, 
life  cycle  cost  estimates  are  one-shot  affairs  and  are  not  profa’antned  as 
scheduled  activities.  Accordingly,  LCC  activities  are  not  geticrally  inte- 
grated into  overall  development  plans."  Ihe  cormlttee  I'ecomnends  that: 

(1)  LCC  goals  and  requirements  be  specifically  stated  in  requests  for  pro- 
posals and  statements  of  work;  (2)  LCC  estimates  should  be  dociniY^nted  as 
part  of  program  plans  and  if  applicable  as  separate  contractor  data  require- 
ment lists;  (3)  the  requirements  for  performance,  relifddlity,  maintain- 
ability, availability  and  cost  be  correlated  such  that  tney  are  conpatible; 
(M)  LCC  estimates  be  required  with  systematic  updating  and  reporting;  (5) 

DoD  slnpllfV  the  methods  required  for  making  LCC  estimates  and  enphasize 
tailoring  the  depth  of  estimates  to  the  decisions  to  be  made;  (6)  ICC, 
reliability  analysis,  maintainability  analysis  and  logistic  support  analysis 
shall  be  done  such  that  they  are  correlatable  to  the  line  replaceable  unit 
(black  boxes)  of  equipment. 
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enough  information  from  what  is  already  available  at  the  con- 
tractor level.  Even  if  the  government  did  ask  for  support  cost 
detail  early  in  the  acquisition  process,  there  is  no  officially 
approved  standardized  format  within  which  to  report  the  infor- 
mation. Standardized  models  with  standardized  equations  and 
requirements  are  necessary  if  DoD  is  to  be  able  to  take  advan- 
tage of  the  full  range  of  support  cost  estimating  activity  that 
goes  on  at  the  contractor  level  before  DSARC  II. 

With  these  policies  as  foundations,  we  can  move  to  a dis- 
cussion of  cost  estimating  methods  in  the  next  section. 

D.  COST  ESTIMATING  METHODS 

As  mentioned  earlier,  the  six  major  cost  estimating  meth- 
odological approaches  available  to  contractors  are: 

(1)  Engineering  bottoms-up 

(2)  Analogy  with  existing  systems 

(3)  Accounting  add-up 

(4)  Simulation 

(5)  Parametric  regression 

(6)  Subjective  expert  Judgment. 

Each  of  these  approaches  is  discussed  in  turn  in  this  section, 
and  examples  of  how  they  are  applied  by  typical  contractors  are 
presented  where  appropriate. 

In  general,  contractor  support  cost  estimating  for  avionics 
and  other  equipments  is  well  developed  and  capable  of  adaptation 
to  many  modeling  techniques. 

1 . Engineering  Bottoms-Up  Approach 

Each  avionics  equipment  producer  is  capable  of  exercising 
its  accumulated  engineering  expertise  to  develop  bottoms-up 
acquisition  cost  estimates  early  in  the  acquisition  cycle, 
certainly  before  DSARC  II  and  DSARC  I.  The  engineering  approach 
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amounts  to  building  a proposed  system  on  paper  and  costing  each 
piece,  part,  and  unit  of  equipment  that  makes  up  the  entire 
avionics  equipment.  The  process  Involves  a detailed  prelimi- 
nary design  which  counts  Items  like  the  number  of  drawings, 
tests,  piece  parts,  and  system-subsystem  Interfaces.  Given  an 
aqulsltlon  cost  determined  by  engineering  expertise  at  the 
bottoms-up  levels,  the  transition  to  support  costs  for  the 
equipment  must  be  made.  Given  that  a detailed  design  has  been 
produced,  nearly  any  methodological  technique  Is  open  to  con- 
tractors. Relating  physical  design  and  performance  character- 
istics to  support  costs  Is  the  goal,  and  the  means  to  the  goal 
may  be  dictated  by  the  specific  requirements  Imposed  on  the 
contractor  by  the  Service  In  the  acquisition  solicitation 
documentation.*  Thus,  the  major  output  of  the  engineering 
bottoms-up  approach  Is  acquisition  cost,  which  can  then  be  used 
In  various  modeling  approaches  to  relate  the  preliminary  design 
to  support  costs.  This  Implicitly  assumes  the  support  costs 
are  explicit  functions  of  acquisition  costs,  and  this  appears 
and  reappears  frequently  In  the  literature  and  research 
approaches  to  support  cost  estimating. 

The  major  virtue  of  the  engineering  approach  is  that 
acquisition  costs  are  provided  at  the  LRA  level  or  lower.  This 
sub-component  level  of  acquisition  cost  detail  permits  the 
utilization  of  various  models  which  translate  acquisition  costs 
for  sub-components  Into  support  costs  through  an  appropriate 
functional  relationship. 

A typical  example  of  the  engineering  bottoms-up  approach 
is  provided  by  the  Westlnghouse  Electric  Corporation's  cost 
estimates  for  the  Electronically  Agile  Radar  (EAR)  system.* 

'items  like  the  official  Statement  of  Worit  (SOW),  Request  for  Proposal  (RFP), 
Request  for  Quote  (RFQ)  are  all  documents  that  can  specify  the  detail  and 
kinds  of  costs  required  to  be  reported  for  the  source  selection  process. 

^Eleatronioally  Agile  Radar  System/Coet  Effeotiveneaa  Plant  Westin^iouse 
Electric  Corporation,  10  Decentoer  1976,  L5C  model  Inputs  required  from  the 
contractor. 
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Engineering  expertise  was  used  tc  develop  acquisition  cost 
estimates  for  the  various  equipments  in  the  EAR  system,  and 
then  these  estimates  were  input  into  a modified  version  of 
the  AFLC  LSC  accounting  support  cost  model. 

The  cost  analysis  group  at  Westinghouse  Electric  was  given 
responsibility  for  both  the  acquisition  and  support  cost  esti- 
mates. Two  reasons  were  offered.  First,  the  cost  group  would 
require  the  acquisition  cost  estimates  as  independent  variable 
Inputs  into  the  LSC  model  in  order  to  produce  support  cost 
estimates,  so  it  was  decided  that  they  should  shepherd  the 
effort  from  its  inception  even  though  acquisition  costs  in 
the  conceptual  stage  are  purely  engineering  estimates  in  equip- 
ment producing  firms  like  Westinghouse.  Second,  the  cost  group 
could  coordinate,  across  various  management  boundaries,  the 
efforts  of  both  engineers  and  policy  decision-makers. 

The  objectives  of  the  Acquisition  Cost  Modeling  (ACM) 
phase  of  the  EAR  program  were  to: 

(1)  provide  visibility  of  cost  estimates  of  a design 
against  cost  targets  suitable  for  trade-offs, 

(2)  provide  estimates  of  costs  as  inputs  to  the 
Westinghouse  version  of  the  LSC  model. 

Cost  quotations  are  derived  within  the  Westinghouse  cost 
accounting  system.  In  establishing  EAR  cost  estimates,  the 
components  of  cost  estimates  are  generated  in  terms  of  Westing- 
house codes  and  nomenclature.  The  codes  for  these  estimates 
are  given  in  Table  22.  Westinghouse  procedures  divide  costs 
into  two  categories  for  acquisition  estimating,  inventory  cost 
of  sales  (ICS),  and  customer  order  development  (COD).  Generally, 
ICS  is  the  effort  that  adds  value  directly  to  a physical  piece 
of  equipment  (i.e.,  material,  manufacturing  labor,  manufacturing 


*See  Chapter  II,  Figures  5 and  6 for  a conprehensive  identification  of  the 
LSC  model  Inputs  required  frcm  the  contractor. 


Table  22.  WESTINGHOUSE  ACCOUNTING  CODE 


Type  Code 

Nomenclature 

A 

Engineering  shop  follow 

E 

Engineering  changes  to  the  product 

F 

Engineering  changes  to  test  equipment 

H 

Manufacturing  labor 

J 

Manufacturing  Material 

K 

Tooling 

L 

Shop  development 

N 

Manufacturing  test 

P 

Q 

Factory  test  equipment 

R 

s 

Quality  assurance 

T 

V 

Manufacturing  inspection 

test,  and  manufacturing  inspection).  COD  is  all  other  Indirect 
costs  necessary  for  the  manufacture  of  the  product. 

A view  of  the  engineering  approach  as  it  is  implemented 
! at  Westinghouse  is  offered  through  examination  of  how  manufac- 

turing labor  costs  were  estimated  for  EAR. 

i As  many  as  forty  cost  centers  in  Westinghouse  contribute 

to  estimating  manufacturing  labor  costs.  These  centers  are 
[i  grouped  into  categories  of  feeders  and  assembly.  Feeders  are 

j manufactured  items  that  become  components  in  assemblies  such 

I as  chassis,  inductive  equipment,  and  base  printed  circuit 

boards.  Assembly,  as  it  sounds,  refers  to  the  actual  assembly 
of  components  into  a final  product. 

Major  operations  performed  within  feeder  and  assembly 
centers  are  categorized  into  set-up  and  run  time  operations. 
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Set-up  time  is  work  done  to  prepare  the  work  stations  for 
performing  a required  manufacturing  operation.  Run  time  is 
the  actual  work  performance  of  the  manufacturing  process. 
Set-up  and  run  times  in  hours  are  established  for  either  the 
performance  of  each  operation,  or  as  an  aggregate  of  a number 
of  operations  on  a center  basis  as  appropriate.  In  such  an 
analysis,  established  hours  are  called  standard  hours  and 
represent  unit  average  time  to  perform  the  operation  for  the 
1000th  unit.  A shop  routing  is  a work  flow  estimation  that 
identifies  operations  and  standard  hours,  and  it  represents 
the  content  of  work  to  be  performed.  Learning  curves  are  then 
applied  to  run  time  standard  hours  to  derive  the  hours  per 
system  for  the  quantity  being  considered.  Learning  does  not 
apply  to  set-up  time;  this  is  a function  of  the  time  over 
which  the  units  are  to  be  produced  or  is  a function  of  the 
number  of  units  produced. 

Each  minor  cost  center  also  operates  with  an  efficiency 
factor  the  reciprocal  of  which  is  defined  as  a conversion 
factor.  This  factor  is  used  to  convert  standard  time  to 
elapsed  time  in  those  centers  which  charge  elapsed  time.  For 
the  EAR  program  Westinghouse  defined  the  factor  as  1.0. 

Summarizing  the  foregoing  narrative  in  a manufacturing 
labor  cost  engineering  bottoms-up  equation,  it  reads: 

HC^q  * [(F1)(K1)+(F2)'K2)+(A1)(K1)+(A2)(K3)](K'0(K5)(K6)(K7) 
where : 

HC^q  - manufacturing  labor  cost  in  1970  dollars 
FI  = feeders  standard  hours  for  set-up  time 

F2  = feeders  standard  hours  for  run  time 

A1  = assembly  standard  hours  for  set-up  time 

A2  = assembly  standard  hours  for  run  time 

K1  = production  rate  factor 

K2  = feeders  run  time  learning  curve  factor 

K3  * assembly  run  time  learning  curve  factor 
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K4  = an  allowance  for  changes  to  the  product 

K5  = normal  production  allowance  (NPA)  factor 

K6  = a costing  rate  adjustment  factor  based  on 
NAVPRO  negotiation 

K7  = costing  rate  in  dollar  per  hour. 

This  lengthy  equation  exemplifies  the  engineering  expertise 
that  goes  into  making  up  avionics  equipment-producer-firm 
acquisition  cost  estimates.  Manufacturing  labor  cost  discussed 
here  is  only  one  of  the  cost  estimates  listed  in  Table  22,  the 
sum  total  of  which  make  up  the  EAR  acquisition  cost  estimates 
for  each  piece  of  EAR  equipment.  Similar  cost  engineering 
bottoms-up  equations  are  developed  and  used  to  compute  the 
other  cost  estimates. 

2 . Analogy  to  Existing  System 

In  a sense,  the  engineering  bottoms-up  approach  is  very 
much  like  drawing  an  analogy  to  an  existing  system,  because 
the  design  engineer  calls  upon  accumulated  experience  with 
prior  systems  to  develop  the  piece  part  count  and  other 
physical  characteristics  for  a new  preliminary  design.  In 
addition,  reliability  and  maintainability  engineers  utilize 
their  cumulative  experience  with  prior  systems  to  develop 
estimates  for  characteristics  like  mean  time  between  failure 
and  mean  time  to  repair.  New  systems  are  not  designed  out  of 
thin  air  without  a baseline  to  work  against,  and  existing  sys- 
tems and  accumulated  experience  on  those  systems  provide  the 
baseline.  This  is,  in  effect,  costing  by  analogy,  but  perhaps 
not  quite  as  rigidly  as  is  usually  meant  by  this  terminology. 

Usually,  analogy  costing  does  not  mean  the  engineering 
approach,  but  instead  means  taking  an  existing  system  that  is 
closest  to  the  new  proposed  system  and  using  its  cost  charac- 
teristics and  profiles  as  baselines  against  which  delta  changes 
will  be  entered  to  define  the  new  system.  A complex  version 
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of  this  approach  entails  taking  subsystems  and  components  from 
many  different  aircraft,  each  component  the  closest  to  the  new 
proposed  design,  and  building  the  analogy  to  the  new  aircraft 
Just  as  the  new  aircraft  is  itself  built  on  paper.  This  com- 
plex analogy  approach  at  the  component  level  has  the  benefit 
of  more  nearly  fitting  the  analogy  components  to  the  new  pro- 
posal, but  it  has  the  disadvantage  of  losing  the  effect  of 
interactions  between  and  among  components.  These  interactions 
may  be  quite  important  to  the  engineer’s  assessment  of  a support 
characteristic  like  MTBP.  For  example,  if  the  engineer  is 
examining  an  existing  operational  radar  as  the  best  analogy 
to  a proposed  new  radar,  the  reported  MTBP  of  the  existing 
radar  must  be  adjusted  up  or  down  or  held  constant  to  reflect 
the  expected  MTBP  of  the  new  radar.  To  make  the  adjustment, 
the  engineer  must  know  the  real  MTBP  drivers  for  both  the 
existing  and  the  proposed  radar.  If  any  of  the  MTBP  dlrvers 
for  the  existing  radar  are  related  to  the  airframe  upon  which 
the  radar  flies,  or  are  related  to  other  components  interfaced 
with  the  radar,  then  these  must  be  reflected  in  the  engineer's 
Judgment  of  how  to  adjust  MTBP.  While  this  is  coneptually 
obvious,  it  is  by  no  means  obvious  that  the  MTBP  data  can  be 
used  as  the  baseline  from  which  to  make  the  adjustments.  The 
MTBP  data  that  the  engineer  sees  on  the  existing  radar  may 
strongly  reflect,  for  example,  the  place  in  the  aircraft  that 
the  radar  is  located.  If  so,  how  does  the  engineer  adjust  the 
observed  MTBP  to  account  for  this  physical  design  character- 
istic that  drives  reliability?  According  to  the  contractor 
engineers  with  whom  we  talked,  there  are  no  hard  and  fast  rules 
for  this  kind  of  problem.  The  solution  depends  heavily  upon 
the  experienced  Judgment  of  the  engineer. 

The  fundamental  issue  characterized  by  this  radar  MTBP 
example  is  that  the  engineers  must  know  the  real  cost  drivers 
behind  MTBP,  MTTR,  and  other  support  characteristics  that  in 
turn  drive  support  costs.  The  analogy  techniqe  may  be  viewed, 
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we  believe,  as  getting  at  the  heart  of  the  avionics  support 
cost  estimating  problem.  The  reason  is  that  the  reliability 
and  maintainability  engineers  must  make  expert  subjective 
Judgments,  and  these  Judgments  are  based,  at  their  best,  on  an 
understanding  of  the  real  support  cost  drivers.  But  these 
understandings  are  not  systematically  formalized  in  design  or 
reliability  and  maintainability  handbooks  that  identify  the 
relevant  cost  drivers  and  relate  them  to  MTBF,  MTTR,  and  other 
support  characteristics.  Instead,  these  drivers  and  their 
functional  relationships  to  support  characteristics  reside 
in  the  cumulative  experience  of  the  design  and  reliability  and 
maintainability  personnel  of  individual  contractors. 

An  entirely  separate  issue  is  that  there  may  be  different 
cumulative  bodies  of  experiences  at  different  contractors,  so 
there  may  be  important  differences  between  the  subjective 
Judgments  made  at  two  difference  avionics  contractor  firms 
concerning  the  application  of  the  analogy  technique  to  new 
proposed  avionics  equipments.  In  the  early  conceptual  stages 
of  equipment  design  and  costing  for  support,  these  differences 
between  firms  r.iay  make  Service  and  OSD  assessments  of  alter- 
native equipments  offered  by  competing  firms  quite  complex 
and  difficult.  (Ways  for  OSD  to  approach  the  independent 
assessment  of  alternative  avionics  equipment  designs  and 
associated  support  costs  are  discussed  in  Chapters  IV  and  V. ) 

According  to  the  contractors  with  whom  IDA  discussed  cost 
estimating  methodology,  all  are  capable  of  engineering  build-up 
and  analogy  approaches,  and  in  the  first  Instance  of  deciding 
to  pursue  a new  program  offered  by  DoD  in  the  pre-DSARC  I phase 
of  exploratory  conceptual  development,  certainly  use  these  two 
approaches  hand-in-hand  to  produce  a broad  estimate  of  the  costs 
involved  in  a new  system  proposal.  Some  emphasized  that  these 
approaches  could  be  implemented  at  any  time  given  some  infor- 
mation about  the  new  system  requirements.  The  more  information 
available  in  the  form  of  DoD  requirements,  the  more  the 
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engineers  and  other  experts  have  to  work  with  in  building  up 
an  analogy.  Regardless  of  which  specific  models  -the  Services 
eventually  direct  contractors  to  use  as  the  bases  for  the 
DSARC  II  and  source  selection  approaches,  the  contractors  agree 
that  engineering  estimates  and  analogies  form  the  central 
character  of  their  initial  cost  estimates. 

3 . Accounting  Add-Up  Approach 

There  are  many  accounting  build-up  models  in  use  by  various 
contractors,  and  most  are  based  on  the  AFLC  LSC  model.  This 
model  is  useful  primarily  as  a design  trade-off  tool  where  the 
design  is  sensitive  to  support  parameters  such  as  MTBF.  This 
is  a critical  assumption  in  the  accounting  model  approach,  the 
linkage  between  design  parameters  and  support  parameters.  If 
the  linkage  is  lacking,  then  the  LSC-type  models  are  somewhat 
insensitive  to  design  changes. 

In  order  to  overcome  problems  created  by  multiple  versions 
of  LSC  and  its  Navy  equivalent,  the  NAVMAT  LCC  model,  a com- 
bined government-contractor  effort  to  produce  a standardized 
accounting  model,  has  created  a new  accounting  life  cycle  cost 
model,  CRIER,  Cost  Redaction  is  Everyone's  Responsibility. 

The  model  and  user's  manual  were  prepared  by  contractor  and 
Service  members  of  the  Life  Cycle  Task  Group  of  the  Joint 
Services  Data  Exchange  for  Inertial  Systems. 

The  model  uses  a set  of  data  inputs  to  compute  RDT&E, 
Acquisition,  and  O&M  costs  for  a piece  of  avionics  equipment, 
subystem,  or  system.  An  extract  from  the  model  handbook 
detailing  the  equations  and  variables  is  presented  in  Appendix  K 
of  this  paper.  The  O&M  equations  compute  costs  for  three  levels 
of  maintenance  as  appropriate  in  the  following  categories:* 

*Each  cost  equation  is  coded  with  a subscript  that  can  indicate  one  of  three 
levels  of  meilntenance . Thus,  each  equation  can  be  processed  for  each  level 
of  maintenance  if  the  cost  category  is  appropriate  at  that  level. 


Direct  maintenance  labor 
Direct  maintenance  material 
Overhead  maintenance  labor 
General  administrative 
Transportation 
Replenishment  spares 
Replacement  training 
Support  equipment  maintenance 
Maintenance  management  data 
Inventory  management . 

The  significant  characteristics  of  accounting  models  are 
that  they  can  provide  substantial  support  cost  details  at  low 
levels  of  Indenture,  and  they  utilize  Inputs,  such  as  acquisi- 
tion cost  estimates,  that  are  Independently  obtained  through 
other  cost  estimating  methodologies. 

4.  Simulation 

There  are  various  kinds  of  simulation  models.  Including 
the  level  of  repair  analysis  (LORA)  models,  and  the  spares 
optimization  models  like  MOD-METRIC. 

The  LORA-type  model  Is  a technique  for  determining  the 
least  cost  level  of  repair  policy  for  new  equipments  as  they 
are  Introduced  Into  the  Air  Force  Industry.  Most  of  these 
models  fall  Into  one  of  three  categories:  single  Item-single 
Indenture;  single  Item-multl  Indenture;  and,  systems  models. 

The  LORA  single  Item-single  Indenture  model  adds  up  the 
various  costs  of  the  three  maintenance  alternatives  for  a given 
LRU: 

(1)  Discard  at  failure 

(2)  Repair  at  base 

(3)  Repair  at  depot. 
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The  least  cost  alternative  is  identified.  This  type  of  model 
requires  the  use  of  allocation  procedures  for  the  costs  of 
items  like  support  and  test  equipment  used  to  repair  more  than 
one  type  of  LRU.  This  requires  several  iterations  of  the  model 
for  each  LRU  to  ensure  that  LRUs  designated  at  a given  level 
carry  totally  allocated  costs . 

In  addition,  this  kind  of  model  decs  not  explicitly  cost 
out  which  of  the  three  alternatives  should  be  used  at  lower 
levels  of  repair  such  as  the  SRU,  module,  and  piece-part  levels. 
Instead,  an  average  or  a maximum  cost  of  the  three  alternatives 
at  each  of  these  lower  levels  is  assumed  known. 

The  Air  Force  Optimum  Repair  Level  Analysis  (ORLA)  model 
is  of  the  kind  described  above,  as  is  the  Navy  LORA  model. 

Most  contractors  employ  one  of  these  two  models  when  doing  this 
kind  of  analysis. 

The  MOD-METRIC  model  is  Intended  to  compute  the  spare  stock 
levels  for  base,  intermediate,  and  depot  levels  for  an  assembly 
and  its  subassemblies.  The  logistics  relationship  between 
assemblies  and  subassemblies  is  identified  by  equations  that 
reflect  the  average  resupply  time  of  an  assembly  as  a function 
of  the  probabilities  that  a given  assembly  failure  was  Isolated 
to  each  of  the  assembly  components  and  the  average  resupply 
time  for  each  component. 


Parametri c 


iressi ons 


IDA  did  not  have  access  to  specific  contractor  regression 
equations  that  are  utilized  for  in-house  cost  estimates,  either 
for  component  acquisition  cost  or  for  component  support  cost. 
All  contractors  agreed  that  they  used  parametric  regressions 
based  on  the  historical  data  in  their  data  banks,  but  that  most 
had  too  few  separate  weapon  system  component  experiences  to 
produce  coefficients  on  the  regression  equations  that  were 
reliable  at  reasonable  (1  percent  or  5 percent)  levels  of 
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significance.  Given  access  to  greater  data  ranges,  they  were 
certain  that  they  could  develop  useful  regression  equations 
that  would  help  them  translate  engineering  build-up  acquisition 
costs  of  components  at  early  conceptual  stages  to  component 
support  costs. 

An  example  of  this  willingness  and  capability  to  develop 
parametric  equations  is  offered  by  the  Grumman  Aerospace  Cor- 
poration project  to  develop  a "Modular  Life  Cycle  Cost  Model 
for  Advanced  Aircraft  Systems”  for  the  Air  Force  Flight  Dynamics 
Laboratory.*  This  project  is  due  to  be  completed  early  in 
calendar  year  1978  with  regression  equations  available  for 
conceptual  and  preliminary  design  phase  cost  estimates.  It  is 
designed  to  produce  regressions  that  will  permit  the  Air  Force 
to  compare,  evaluate,  and  determine  the  life  cycle  cost  impact 
of  competing  design  alternatives  for  transport/cargo/tanker 
and  fighter/attack  airframes,  engines,  and  avionics.  Cost  data 
are  to  be  extracted  from  Grumman *s  and  Lockheed's  in-house  data 
banks,  extensively  supplemented  by  Air  Force  data  on  other  con- 
tractors* aircraft.  This  is  a case  where  an  aircraft  prime 
contractor  is  willing  to  develop  avionics  support  cost  estimat- 
ing procedures  even  though  the  contractors  engineering  exper- 
tise does  not  Include  production  line  knowledge  at  the  avionics 
component  level.  Such  engineering  expertise  at  the  production 
level  is  not  required  here  because  the  estimating  technique  is 
to  look  at  historical  data  and  to  perform  regressions. 

Table  23  displays  the  parametric  CERs  that  Grumman  has 
tentatively  identified  as  the  major  outputs  of  their  research 
effort.  As  can  be  seen,  there  is  substantial  detail  available 
at  the  two-digit  WUC  level.  Currently,  avionics  is  treated  as 
a single  lump  sum  Inclusive  of  WUCs  52,  55,  56,  7*1,  76,  and  77 
(see  Table  2 in  Chapter  I).  A single  equation  is  available 


'Proposal  for  Modular  life  Cycle  Cost  Model  for  Advanced  Aircraft  Systems, 
January  5»  1976,  prepared  for  AP  Pll^t  Dynamics  Laboratory. 
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for  WUC  75,  weapons  delivery.  Grumman  Is  confident  that  It 
has  sufficient  data  to  produce  avionics  support  cost  parametric 
equations  for  each  two-digit  WUC,  but  this  Is  not  a requirement 
of  the  contract  with  the  Flight  Dynamics  Laboratory. 

The  categories  of  support  costs  available  Include  replen- 
ishment spares,  base  level  maintenance,  and  depot  component 
repair,  among  others  In  Table  23,  but  these  three  are  directly 
related  to  the  support  cost  focus  of  this  paper.  We  believe 
that  this  Grumman  work  provides  a viable  potential  for  paramet- 
ric two-digit  WUC  support  cost  estimating  equations. 

Another  example  of  regression  support  cost  activity  In 
the  avionics  area  Is  In  the  Westlnghouse  contract  with  the  AF 
Avionics  Laboratory  to  develop  avionics  equipment  support  cost 
regression  equations  which  specifically  link  design  parameters 
to  support  costs.  This  Is  an  ambitious  project  that  Is  specifi- 
cally Intended  to  produce  a mathematical  model  which  accurately 
predicts  downstream  logistic  support  and  maintenance  costs  of 
avionics  during  the  conceptual  and  preliminary  design  phases 
of  the  acquisition  process. 

An  Interesting  feature  of  the  Avionics  Laboratory  Statement 
of  Work  that  was  provided  to  potential  bidders  In  the  contract 
award  process  Is  the  requirement  that  the  model  "...be  Inde- 
pendent of  the  avionics  function,  l.e.,  a generalized  model 
that  will  predict  support  and  maintenance  costs  for  navigation 
equipment,  radar  systems,  radios,  etc."*  Previous  avionics 
support  cost  model  research  funded  by  the  Avionics  Laboratory 
focused  on  equipment-unique  parametric  equations,  producing  a 
separate  equation  for  each  of  several  types  of  avionics  equip- 
ments, such  as  fire  control  radars  and  FLIRs.* 

‘Air  Force  Avionics  Laboratorv,  Statement  of  Work:  Ppediotive  Operation- 
and-Maintenanee  Coat  Model,  Purchase  Request  No.  FY11757720318,  1977. 

*Alr  Force  Avionics  Laboratory  (AFAL)  TR-73-^^l»  Coet  Analyeia  of  Avionioe 
Equipment,  APAL-'IR-75-15»  Coet  Estimating  Relationahipe  for  Airborne  Array 
Radare,  FLIRe,  and  Avionioe  Logietio  Support,  Volumes  1 and  2,  February  197^. 
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(10)  Depot  costs.  Including  training 

(11)  Support  equipment  costs 

(12)  Documentation  costs 

(13)  Facilities  costs. 

There  seems  to  be  no  reluctance  on  the  part  of  contractors 
to  develop  regression  equations,  and  in  early  design  stages 
they  may  be  quite  useful  for  relating  acquisition  costs  to 
support  costs  and  design  parameters  to  support  costs. 

A widely  used  proprietary  regression  model  is  the  RCA 
PRICE  model.  Its  equations  are  not  public  knowledge,  but  its 
methodology  appears  to  Involve  the  use  of  a vast  data  bank  of 
historical  Information  at  the  piece-part  level  of  detail  to 
generate  1400  parametric  equations. 

The  PRICE  (Programmed  Review  of  Information  for  Costing 
and  Evaluation)  is  an  RCA-developed  parametric  cost-modeling 
technique.  It  provides  estimates  of  system  acquisition  costs 
based  on  physical  parameters  such  as  quantity,  size,  weight, 
power  consumption,  environmental  specification,  type  of  pack- 
aging, and  level  of  integration.  PRICE  estimates  are  also 
based  on  schedule  parameters  such  as  months  to  first  proto- 
type, manufacturing  rate,  and  amount  of  new  design.  More 
detailed  discussions  of  the  PRICE  acqusitlon  estimating 
capability  are  provided  in  Appendix  L. 

Recently  RCA  has  expanded  PRICE  to  Include  a life  cycle 
cost  capability.  Called  PRICE  L (see  Appendix  L),  it  provides 
a methodology  for  rapidly  computing  support  costs  for  many 
varieties  of  systems.  Required  user  inputs  include  factors 
for  equipments  employment,  deployment,  maintenance  policy 
and  levels  of  support  capability,  equipment  and  maintenance 
locations,  and  total  years  to  the  life  of  the  system.  All 
other  required  Inputs  are  developed  by  the  PRICE  model  or 
directly  input  by  the  user  at  the  user's  option.  This  linkage 
to  the  basic  PRICE  acquisition  model  suggests  that  the  LCC 


basis  for  PRICE  L is  a set  of  support  cost  factors  applied  to 
acquisition  costs. 

These  inputs  that  are  either  calculated  by  the  PRICE 
acquisition  model  or  directly  input  by  the  PRICE  L user 
Include ; 

(1)  Line  replaceable  unit  (LRU)  MTBF 

(2)  Mean  time  to  repair  for  LRUs  and  modules 

(3)  Unit  costs  for  LRUs,  modules,  and  parts 

(^)  Development  cost 

(5)  Non-recurring  production  costs 

(6)  Number  of  module  and  part  types 

(7)  Fraction  of  non-standard  parts 

(8)  Cost  for  contractor  repair  of  LRUs  and  modules 

(9)  Cost  for  LRU  test  set  and  for  combined  LRU  and 
module  test  set 

(10)  Learning  curves  for  LRUs,  modules,  and  parts 

(11)  Duration  of  development  and  production  periods 

(12)  Shipping  weights  for  LRUs,  modules,  and  parts 

(13)  Storage  cubes  for  LRUs,  modules,  and  parts 

(14)  Floor  space  required  for  LRU  test  sets  and  LRU 
and  module  test  sets 

Because  these  data  inputs  are  quite  extensive,  it  seems  likely 
that  a PRICE  L user  would  tend  to  avoid  directly  inputting  these 
values  and  would  Instead  opt  for  providing  the  basic  inputs 
to  the  PRICE  model  and  letting  the  PRICE  model  calculate  the 
above  listed  14  inputs  to  PRICE  L. 

The  life  cycle  cost  outputs  of  PRICE  L are  presented  in 
Table  24.  PRICE  L does  not  calcualte  costs  for  field  testing, 
operation,  site  facilities,  anticipated  system  or  modification 
changes,  and  government  adminstration.  If  values  for  these 
costs  are  known  to  the  user,  they  can  be  throughput  into  the 
model  and  printed  out  with  the  caluculated  life  cycle  costs 
and  Included  in  the  LCC  totals.  Appendix  L provides  a sample 
PRICE  L life  cycle  cost  output  sheet. 


Table  24. 


PRICE  L BASIC  OUTPUTS 


Output  Category 

Discussion 

Most  Cost  Effective 

PRICE  L assesses  19  alternative 

Maintenance  Concept 

maintenance  concepts  and  identifies 
the  lowest  cost  concept  and  prints 
it  on  the  output  sheet. 

Cost  Effective  Mainte- 

All  19  maintenance  concepts  are 

nance  Concept  List 

ranked  from  lowest  cost  to  highest 
and  printed  out  along  with  a ranking 
number  equal  to  100  for  the  lowest 
cost  concept  and  higher  numbers  for 
the  other  concepts. 

Development  Costs 

Dollar  values  for  development  costs 
in  the  following  categories  are 
printed:  equipment,  support  equip- 
ment, manpower,  supply,  supply 
administration,  contractor  sup- 
port, and  other. 

Production  Costs 

Dollar  values  for  production  costs 
are  printed  in  the  same  categories 
as  given  above  for  development 
costs . 

Support  Costs 

1 

Dollar  values  for  support  costs  are 
printed  in  the  same  categories  as 
given  above  for  development  costs. 

The  first  two  blocks  of  output  information  identified  in 
Table  24  relate  to  the  most  cost  effective  maintenance  concept 
from  among  the  19  presented  in  Table  25.  The  output  sheet 
identifies  which  of  these  is  least  costly,  and  ranks  all  19 
concepts  from  lowest  to  highest  cost.  The  lowest  cost  concept 
carries  a ranking  number  of  100,  and  the  other  highest  cost 
concepts  carry  numbers  greater  than  100  in  proportion  to  the 
excess  of  their  costs  over  the  costs  of  the  lowest  cost  concept. 
Thus,  if  concept  number  15  were  the  lowest  cost  concept  it  would 
carry  a ranking  number  of  100,  and  if  concept  number  5 carried 
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Table  25.  MAINTENANCE  CONCEPTS  ASSESSED  IN  PRICE  L 


Ma  i ntenance 
Concept  No. 

Maintenance  Concept 

1 . 

LRU  discard  at  failure. 

2. 

LRU  repair  at  Organization.  Module  discard. 

3. 

LRU  repair  at  Intermediate.  Module  discard. 

4. 

LRU  repair  at  Depot.  Module  discard. 

5. 

LRU  repair  at  Organization.  Module  repair  at 
Intermediate. 

6. 

LRU  repair  at  Organization.  Module  repair  at 
Depot . 

7. 

Repair  LRU  to  piece  part  at  Intermediate. 

8. 

LRU  repair  at  Intermediate.  Module  repair  at 
Depot. 

0 

9. 

Repair  LRU  to  piece  part  at  Depot. 

10. 

Repair  LRU  to  piece  part  at  Organization. 

11  . 

On-equipment  repair  to  module.  Module  discard. 

12. 

On-equipment  repair  to  module.  Module  repair  at 
Organi zati on . 

13. 

On-equipment  repair  to  module.  Module  repair  at 
Intermediate. 

14. 

On-equipment  repair  to  module.  Module  repair  at 
Depot . 

15. 

LRU  repair  at  Contractor  Depot.  Module  discard. 

16. 

On-equipment  repair  to  module.  Module  repair  at 
Contractor  Depot. 

17. 

LRU  repair  at  Organization.  Module  repair  at 
Contractor  Depot. 

18. 

LRU  repair  at  Intermediate.  Module  repair  at 
Contractor  Depot. 

19. 

Repair  LRU  to  piece  part  at  Contractor  Depot. 

16k 


a ranking  number  of  346,  you  could  interpret  the  quantitative 
relationship  between  the  two  concepts  as:  number  5 is  more 
than  three  times  as  costly  as  number  15 . (See  Appendix  L for 

a sample  maintenance  concept  list . ) 

♦ 

The  development  costs,  production  costs,  and  support  costs 
identified  in  Table  24  are  displayed  on  the  PRICE  L output 
sheets  in  a format  like  Table  26. 

Further  details  on  the  PRICE  L model  are  discussed  in 
Appendix  L,  but  this  does  not  Include  the  equations  on  the 
internal  model  configurations  which  yield  the  cost  estimates 
because  PRICE  and  PRICE  L are  RCA  proprietary  instruments. 

6 . Subjective  Expert  Judgment  Approach 

Throughout  acquisition  cost  and  support  cost  estimating, 
subjective  expert  Judgments  play  a role.  Regardless  of  the 
methodology,  an  expert  Judgment  can  change  the  value  of  a 
variable  in  an  equation.  These  Judgments  introduce  real  world 
value  Judgments  into  the  mechanical  mathematical  processes  of 
computing  costs. 

E.  DATA  AND  MANAGEMENT  SYSTEMS 

The  support  cost  data  and  management  systems  available  to 
contractors  are  usually  restricted  to  data  from  the  Air  Force 
and  the  Navy  on  their  own  equipments.  This  restriction  is  one 
reason  why  contractors  are  often  willing  to  engage  in  cost 
methodology  studies  for  the  Services,  because  the  contract  may 
permit  them  to  gain  access  to  data  on  other  contractors'  sys- 
tems . 

Internally  contractors  have  their  own  engineering  level 
data  available  to  develop  early  cost  estimates,  but  these  data 
are  proprietary  and  difficult  for  other  firms  to  acquire.  It 
is,  of  course,  primarily  useful  for  acquisition  cost  estimates. 
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Table  26.  COST  MATRIX  FORMAT  FOR  PRICE  L 


Cost  Elements 

Cost  Categories 

Total 

Development 

Product! on 

Support 

Equi pment 

Support  Equipment 

Manpower 

Supply 

Supply  Administra- 
ti  on 

Contractor  Support 

Other 

Sub-Total 

Throughput  Costs 

TOTAL  COSTS 

not  support  costs.  These  latter  costs  are  primarily  housed  in 
the  Services  reporting  systems  Identified  in  the  earlier 
chapters . 

F.  SUMMARY 

Contractor  cost  estimating  methodologies  range  throughout 
the  various  forms  of  support  cost  estimating  available.  At 
the  contractor  equipment-producer  level,  engineering  and  analogy 
methods  are  most  prevalent,  while  at  the  contractor  aircraft- 
producer  level,  accounting  and  parametric  regression  methods 
prevail.  All  of  these  methods  and  others  Interact  through 
iterative  processes  and  this  interdependence  characterizes 
contractor  cost  estimates.  The  general  contractor  view  of  these 
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policies  Is  that  the  Services  do  not  ask  for  enough  support  cost 


data  early  enough  and  at  a low  enough  level  of  detail.  There- 
fore, contractors  doubt  that  support  costs  on  equipments  like 
avionics  are  major  design  influencing  factors  in  the  govern- 


Chapter  IV 


EVALUATIONS  OF  SUPPORT  COST  MODELING  METHODOLOGIES 
UTILITIZED  BY  THE  SERVICES  AND  CONTRACTORS 


A.  INTRODUCTION 

There  are  two  broad  classes  of  scientific  models  that 
represent  all  the  cost  estimating  approaches  discussed  in  the 
previous  chapters — deterministic  models  and  stochastic  models. 
Deterministic  models  do  not  explicitly  Include  uncertainty  in 
their  structures,  stochastic  models  do.  A common  class  of 
deterministic  models  is  the  accounting  model  (AFLC-LSC,  Navy 
LCC,  CRIER)  that  accepts  all  input  values  as  precise  and  sums 
model  elements  to  produce  cost  sub-totals  and  totals.  A common 
class  of  stochastic  models  is  the  parametric  regression  model 
(Navy  F-l8  top  level.  Avionics  Laboratory-sponsored  research, 
Grumman-Lockheed  Georgia  contract)  that  explicitly  incorporates 
uncertainty  into  its  structure  and  provides  measures  of  the 
ranges  of  uncertainty  attached  to  its  cost  products.  These 
two  model  classes  constitute  the  background  against  which  the 
various  modeling  approaches  presented  in  the  earlier  chapters 
may  be  assessed.  The  purposes  of  these  assessments  are  to: 

(1)  describe  the  fundamental  similarities  and  differ- 
ences between  and  among  the  several  methodological 
approaches ; 

(2)  assess  the  usefulness  of  the  various  models  for 
estimating  component  support  costs,  especially 
early  in  the  acquisition  process; 

(3)  identify  whether  the  modeling  techniques  are 
appropriate  for  estimating  point  values  of 
support  costs; 
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(i|)  identify  whether  the  modeling  techniques  are 
appropriate  for  trade-off  comparisons  between 
or  among  alternative  components. 

B.  REGRESSION  MODELS 
1 . Overall  Assessment 

The  strong  appeal  of  a regression  equation  estimating  tech- 
nique is  grounded  in  its  ease  of  application.  Once  the  equation 
is  created,  its  use  is  merely  a matter  of  placing  a few  variable 
values  in  the  equation  and  processing  the  equation  to  calculate 
the  cost  dependent  variable.  The  unique  advantage  of  a regres- 
sion equation  is  that  it  permits  formal  estimates  of  the  degree 
of  certainty  associated  with  its  calculated  results.  Among  the 
requirements  that  must  be  met  for  a regression  equation  to  be 
useful  are  that  the  data  must  be  available  in  the  categories 
presumed  to  be  relevant,  and  the  relevant  categories  must  be 
selected  based  on  prior  expert  knowledge  of  the  real  functional 
relationship  between  support  costs  and  the  cost  drivers  (inde- 
pendent variables). 

The  avionics  support  cost  regression  equations  at  the  com- 
ponent level  that  we  examined  in  our  research  suffered  both 
from  a lack  of  relevant  data  availability  and  from  a lack  of 
expert  knowledge  of  the  real  cost  drivers  for  specific  types 
of  component  equipments.  These  two  requirements  have  appeared 
to  be  interrelated  in  these  studies.  Theoretical  discussions 
of  the  relevant  cost  drivers  are  brief  and  infrequent.  The 
cost  drivers  put  forward  as  relevant  have  frequently  been  a 
function  of  the  data  available.  Independent  variables  seem  to 
have  been  selected  in  some  instances  because  data  were  avail- 
able on  their  magnitude,  not  because  the  variables  were  logically 
related  to  the  support  costs  of  component  equipment.  This  latter 
condition  is  an  unavoidable 
gatlons  but  its  unavoidable 
desirable  or  acceptable.  As 


theoretical  assessment  of  relevant  cost  relationships  will  be 
inhibited.  This  fundamental  fact  offers  some  Justification 
for  the  substantial  scepticism  that  we  encountered  in  our 
research  concerning  the  usefulness  of  currently  available  sup- 
port cost  regression  equations  for  avionics  components. 

Another  form  of  these  Interrelated  problems  of  the  lack  of 
relevant  data  and  the  subsequent  lack  of  theoretical  analysis 
of  the  real  cost  drivers  is  that  regression  equations  are  some- 
times processed  merely  to  ascertain  which  Independent  variables 
provide  the  highest  coefficient  of  correlation. 

The  great  danger  present  in  basing  the  theoretical  relation- 
ship to  be  tested  on  the  data  available  is  that  the  real  theo- 
retical relationships  may  be  entirely  missed  or  obscured  because 
the  data  dc  not  actually  reflect  the  real  functional  relation- 
ships. A theoretical  appreciation  of  the  functional  relation- 
ship between  costs  and  drivers  must  be  the  basis  for  a cost 
estimating  regression  equation. 

Interestingly,  part  of  the  data  problem  has  been  with 
respect  to  the  dependent  variables  (the  support  costs)  in  the 
regression  equations,  as  well  as  with  the  independent  variable 
cost  drivers.  If  the  cost  data  being  "explained”  by  the  regres- 
sion equation  do  not  represent  the  real  costs  of  a particular 
support  activity,  then  the  equation  provides  inaccurate  coeffi- 
cients which  misspeclfy  the  true  relationships  between  the 
cost  drivers  and  the  costs. 

Some  analysts  have  suggested  that  regression  equations  are 
not  useful  for  component  support  cost  estimates  because  the 
real  cost  drivers  are  not  only  physical  design  and  performance 
characteristics,  but  also  are  environmental  constraints  like 
maintenance  and  operating  policies.  It  is  argued  that  mainte- 
nance and  operating  policies  are  difficult  to  quantify.  Under 
some  circumstances  this  concern  is  unsubstantiated  by  a careful 
consideration  of  its  implications.  Comparisons  between 
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alternative  avionics  equipments  subject  to  the  same  maintenance 
and  operating  policies  are  unaffected  by  the  absence  of  a vari- 
able to  represent  these  policies.  In  this  case,  the  policies 
are  like  fixed  costs  and  are  the  same  for  all  equipments.  But 
if  alternative  maintenance  or  operating  policies  are  the  distin- 
guishing characteristics  differentiating  one  avionics  equipment 
from  its  competitive  alternatives,  it  is  possible  to  treat  the 
different  policies  in  the  regression  equation  through  the  use 
of  dummy  variables.  This  has  limited  usefulness  and  does  not 
permit  small  discrete  differences  to  be  regressed  in  the  equa- 
tions. Another  approach  is  to  use  proxy  variables  that  can  be 
quantitatively  measured  and  which  approximate  the  effects  of 
maintenance  and  operating  policies.  Suitable  proxy  variables 
have  not  yet  been  identified  in  the  literature.  These  approaches 
may  be  especially  appropriate  when  the  cost  being  estimated, 
the  dependent  variable,  is  total  maintenance  cost  which  incor- 
porates elements  of  both  fixed  and  variable  costs. 

I 

2 . The  Navy  F-18  Regression  Equations 

The  P-l8  top  level  system  equations  do  not  estimate  support 
[l  costs  at  the  component  level.  The  costs  are  estimated  for  the 

total  weapon  system  in  several  categories  including  enlisted 
maintenance  and  operating  personnel,  depot  component  rework, 
replenishment  spares,  and  other  consumables.  These  total  system 
costs  are  then  allocated  to  two-digit  work  unit  codes  with  the 
allocation  factors  based  on  historical  cost  experience  on  the 
F-^J  TMS  aircraft.  This  methodological  variation  offers  inter- 
esting potentials  for  early  acquisition  cycle  component  cost 
estimates,  although  not  necessarily  with  the  specific  cost  ele- 
ments used  for  the  P-l8. 


As  explained  in  Chapter  II,  the  dependent  variable  costs 
are  taken  from  the  NARM  program  factors  categories.  The  NARM 
provides  the  data  base  for  component  rework,  replenishment 
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spares,  and  other  consumables  costs  for  several  aircraft  which  j 

are  regressed  as  dependent  variables  against  aircraft  charac-  | 

teristics'  variables.  The  difficulty  with  these  cost  data  is  | 

that  the  NARM  dollar  values  may  not  represent  actual  expend!-  | 

tures  of  resources  in  the  various  cost  categories.  The  costs  i 

recorded  in  the  NARM  for  budgeting  purposes  may  bear  some  rela-  Ij 

tlonshlp  to  actual  work  performed  on  avionics  equipments  or  | 

aircraft,^  but  the  relationship  may  be  obscured  by  the  require-  j 

ments  of  the  budgeting  process.  I 

The  component  rework  equation  could  not  produce  both  a high  1 

coefficient  of  determination  and  a theoretically  reasonable  set  ] 

of  equation  variables  according  to  McDonnell-Douglas  aircraft  | 

research  reports.^  It  seems  that  the  equation  does  not  repre-  \ 

sent  the  real  relationship  between  component  rework  costs  and  1 

its  drivers.  Nonetheless,  the  DSARC  II  submission  of  cost  esti- 
mates used  the  equation.  It  contains  a term  that  is  empty 
weight  of  the  aircraft  divided  by  mean  flight  hours  before 
failure  (MFHBP).  This  term  lacks  intuitive  appeal  as  an  obvious 
logical  cost  driver  for  component  rework,  or  anything  else.  The 
coefficient  of  determination  may  be  low  because  of  trouble  on 
the  dependent  variable  cost  side  of  the  equation;  the  budget- 
constrained  NARM  component  rework  collars  in  the  regression  data 
base  may  not  be  a true  measure  of  depot  work  performed.  If  it 
is  not,  then  the  coefficient  of  determination  between  it  and 
physical  characteristics'  Indepdendent  variables  may  have  little 
meaning. 


‘Conponent  rework  Includes  the  cost  of  repadring  components  at  the  depot, 
both  scheduled  and  unscheduled,  and  the  majority  of  this  activity  is  for 
avionics  conponents.  Other  consumables  consist  of  non-repalrable  consum- 
able material  used  for  organizational  and  Intemiediate  maintenance,  and 
repair  of  repalrables.  Most  of  these  materials  are  consumed  by  avionics 
WUCs. 

*C.E.  Eamhart,  Improved  Life  Cycle  Cost  Eatimating,  Report  No.  MDC  A^563> 
McDonnell  Dou^as  Aircraft  Conpany,  December  22,  1976. 
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Replenishment  spares  costs  were  estimated  with  an  equation 
involving  avionics  suite,  propulsion,  and  airframe  acquisition 
costs,  as  well  as  empty  aircraft  weight,  aircraft  velocity  maxi- 
mum, and  MPHBF  as  the  independent  variables.  Again,  one  of  the 
terms  is  empty  weight  divided  by  MPHBF,  without  any  explanation 
of  the  supposed  theoretical  relationship  between  this  term  and 
replenishment  spares.  Although  the  equation  (shown  in  Chapter 
II)  was  used  to  estimate  DSARC  II  costs,  subsequent  research 
by  McDonnell-Douglas  on  the  equation  leads  them  to  reject  it 
because  of  data  deficiencies  in  the  historical  replenishment 
spares  cost  data,  which  was  determined  to  have  been  "developed 
by  an  allocation  technique."^ 

To  overcome  the  cost  data  difficulties  present  in  the  HARM 
budget-constrained  data,  this  approach  could  be  pursued  using 
VAMOSC  Maintenance  Subsystem  Data  for  costs.  Because  of  the 
greater  detail  for  costs  available  in  the  VAMOSC  reports,  sepa- 
rate equations  could  be  prepared  for  organization,  intermediate, 
and  depot  maintenance.  Separate  scheduled  and  unscheduled 
maintenance  equations  could  be  prepared  for  organization  and 
intermediate  maintenance,  and  for  NARP  and  commercial  depot 
actions  if  desired. 

Given  that  theoretically  acceptable  cost  data  can  be  obtained, 
this  only  gets  us  as  far  as  total  weapon  system  cost  estimating 
equations.  Thes^  are  desirable  for  early  acquisition  cycle 
estimates  because  they  require  a few  data  inputs.  Our  discus- 
sions with  contractors  reveal  that  as  early  as  DSARC  I,  airframe 
contractors  could  provide  independent  variable  values  for  weight, 
maximum  velocity,  MPHBF  (through  engineering  analysis  of  analo- 
gous systems),  and  acquisition  costs  for  airframe,  propulsion, 
and  avionics. 

The  allocation  of  these  estimates  to  WUC  could  be  accom- 
plished as  in  the  F-l8  case  by  picking  a single  operational 


1 

i 

j 

i aircraft  that  Is  most  analogous  to  the  proposed  aircraft.  Then, 

I 

I use  of  the  two-digit  VAMOSC  WUC  values  for  the  various  costs  as 

i proportioning  factors  would  allocate  the  total  weapon  system 

cost  estimate  to  WUCs  on  the  proposed  aircraft.^ 

A more  sophisticated  version  of  this  approach  would  be  to 
select  various  WUC  analogous  equipments  from  the  entire  Inventory 
of  avionics  equipment,  regardless  of  whether  the  equipments  are 
on  one  or  several  aircraft.  Assuming  that  they  are  on  several 
aircraft,  the  WUC  costs  for  a cost  category,  such  as  depot  mainte- 
nance, could  be  added  to  form  a total,  then  each  WUC  cost,  per- 
haps from  different  aircraft,  could  be  turned  into  proportioning 
factors  for  the  new  P-X  aircraft  proposal.  This  multiple  air- 
craft analogous  WUC  selection,  forming  the  basis  for  the  total 
P-X  equation  allocations  to  WUC,  would  enjoy  the  benefit  of 
tailoring  each  WUC  equipment  to  its  closest  analogy. 

This  tailoring  approach  has  another  potential.  It  could 
be  used  to  trade-off  alternative  types  of  avionics  systems. 

Assume  that  one  P-X  proposal  at  DSARC  proposed  an  P-l8  avionics 
suite  as  most  analogous.  Using  the  P-l8  VAMOSC  cost  data,  the 
P-l8  based  proportioning  factors  could  be  used  to  allocate  total 
weapon  system  regression  estimates.  An  alternative  avionics 
suite,  say  on  the  P-l6,  could  be  substituted  to  develop  the 
proportioning  factors.  The  differential  impacts,  if  any,  of 
the  two  avionics  suites  on  the  proportioning  factors  would  pro- 
vide an  initial  comparative  trade-off  potential  among  alterna- 
tive avionics  suites  early  in  the  acqusltlon  cycle. 

The  approach  to  component  support  cost  estimating  repre- 
sented by  the  Navy’s  P-l8  total  system  regressions,  followed 
by  analogy  WUC  allocation  factors,  is  useful  both  for  point 
estimating  and  for  trade-off  comparisons.  The  problems  in  the 
Navy  system  could  be  overcome  with  Improved  data  sources. 


'ihls  procedure  as  applied  to  the  P-l8  is  explained  in  Chapter  H. 
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Avionics  Laboratory  Research 

The  Air  Force  Avionics  Laboratory  avionics  support  cost 
estimating  regression  equations  currently  available  are  largely 
exploratory  results  not  Intended  to  actually  be  used  for  cost 
estimating  in  their  present  forms.  The  major  difficulty  with 
the  equations  is  the  dependent  variable  cost  data  validity. 

The  cost  data  are  simply  Incomplete,  so  the  equations  are 
qualified  as  being  representative  of  the  form  that  such  work 
might  take  in  the  future,  but  not  representative  of  currently 
useful  regressions. 

The  In-progress  work  for  the  Avionics  Laboratory  by  Westing- 
house  is  Intended  to  produce  a "predictive  operation  and  mainte- 
nance cost  model"  at  the  avionics  subsystem  level.  This  model 
is  to  be  composed  of  equations  that  are  not  peculiar  to  any  one 
functional  category  of  avionics  equipment,  but  instead  will 
apply  to  any  piece  of  equipment  without  specific  characteristic 
uniqueness  identified  to  that  equipment  built  into  the  equation. 
This  is  a requirement  that  seems  difficult  to  fulfill.  The 
underlying  assumption  here  is  that  there  are  certain  key  cost- 
driving  design  parameters  that  are  common  to  all  avionics  equip- 
ments in  the  inventory.  If  this  assumption  were  correct,  equa- 
tions common  to  all  the  avionics  inventory  could  be  developed, 
given  reliable  cost  data  for  the  regressions  and  accurate  iden- 
tification of  the  correct  cost  drivers.  But  then  these  are  the 
requirements  of  any  valid  regression  model.  It  is  Interesting 
that  the  1974  Avionics  Laboratory-sponsored  avionics  support 
cost  research  suggests  that  general  across-avlonics  system 
equations  are  not  valid  because  of  the  great  differences  among 
alternative  avionic  systems.'  With  specific  reference  to  air- 
borne array  radar  cost  analysis,  the  1974  report  concludes  that 


*E.N.  Dodson,  S.F.  Komlsh,  Cost  Estimating  Relationships  for  Airborne  Arrray 
Radars,  FLIRs,  and  Avionics  Logistics  Support  (U),  AFAL-IT?- 75-15 » Vol.  H, 
Air  Force  Avionics  Laboratory,  Wrig^t-Patterson  AFB,  Ohio,  August  1975. 
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"In  short,  a sample  of  current  radars  is  a distinctly  hetero- 
geneous set,  and  aggregated  cost  comparisons  must  be  made  with 
great  care.  Again,  the  recourse  is  to  carry  out  cost  analysis 
at  finer,  disaggregated  levels  of  detail  so  that  the  unique 
(and  common)  features  can  be  explicitly  treated."  This  seems 
to  contradict  the  spirit  of  the  current  Westlnghouse  effort  to 
develop  non-unique  across-avionics-systems  regression  equations 
for  support  costs. 

C.  ACCOUNTING  MODELS 
I . Overall  Assessment 

Accounting  support  cost  models  are  deterministic  models 
that  add  up  costs  at  detailed  equipment  levels.  Early  in  the 
acquisition  cycle  for  a new  F-X  aircraft,  the  only  source  of 
data  for  such  a model  is  analogy  to  existing  systems.  The 
successful  use  of  analogy  data  in  both  the  Navy  and  the  Air 
Force  versions  of  support  cost  accounting  models  until  recently 
has  been  inhibited  by  multiple  data  systems  that  produce  diffi- 
cult to  reconcile  data.  The  recent  addition  of  the  VAMOSC 
Maintenance  Subsystem  in  the  Navy  greatly  enhances  the  Navy's 
capability  for  analogy  component  costing  using  accounting  models. 
The  Air  Force  is  still  developing  an  equipment-level  LRU-SRU 
support  cost  reporting  system  to  complement  its  weapon  system- 
level  OSCER  system.  Complicating  the  data  even  further  has 
been  the  lack  of  a direct  linkage  between  organizational  and 
intermediate  maintenance  WUC  reporting  categories  and  depot 
maintenance  National  Item  Identification  Numbers  (NIINs). 

The  frequently  used  accounting  models  like  the  AFLC  LSC 
model  and  the  Navy's  LCC  model  have  another  characteristic 
that  weakens  their  usefulness  as  design  and  performance  dis- 
criminators. Logistic  support  costs  are  computed  as  functions 
of  logistic  reliability  and  maintainability  parameters  in  these 
models,  but  performance  and  design  characteristics  play  no  role 
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In  the  functional  relationship  between  support  costs  on  one 
side  of  the  equations  and  the  cost  drivers  on  the  other  side. 
Variables  like  type  of  materials,  size,  speed,  and  range  have 
no  role  to  play  in  these  estimates. 

A final  difficulty  with  accounting  models  is  inherent  in 
their  deterministic  natures.  Because  there  are  uncertainties 
surrounding  the  data,  the  accounting-type  model  is  at  a dis- 
advantage for  lacking  techniques  that  can  estimate  the  ranges 
of  uncertainty  attached  to  costs  produced  as  accounting  model 
outputs . 

2.  AFLC  LSC  Model 

The  mechanics  of  the  LSC  model  have  been  extensively  dis- 
played in  Figures  1 through  6 in  Chapter  II.  Given  the  weak- 
nesses of  the  model,  cost  estimates  based  on  analogy  estimates 
early  in  the  acquisition  cycle  are  of  limited  usefulness.  Once 
actual  test  data  become  available,  however,  the  LSC  model  takes 
on  a different  character.  Given  actual  data,  it  provides  a 
convenient  set  of  processing  and  organizing  equations  for  the 
cataloguing  of  logistic  support  costs. 

Its  usefulness  as  a source  selection  cost  model  seems 
limited  as  long  as  analogy  data  are  limited.  Without  a capa- 
bility in  the  Services  and  OSD  for  verifying  the  LSC  model 
inputs  received  from  contractors  as  the  source  selection 
approaches,  the  source  selection  cost  estimates  have  no  dis- 
cipline external  to  the  contractor's  decisions  Imposed  upon 
their  magnitudes. 

The  Air  Force  has  attempted  to  Impose  such  discipline  in 
the  F-l6  program  by  utilizing  selected  LSC  equations  as  the 
basis  for  what  is  called  the  Target  Logistic  Support  Cost  (TLSC) 
program  mentioned  in  Chapter  II.  The  data  to  input  into  the 
equations  are  derived  at  the  time  of  the  3500-flight-hour  test 
for  the  F-l6  aircraft.  But  this  is  a test-based  system  and 
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would  not  be  available  in  the  conceptual  development  phases  of 
the  acquisition  cycle. 
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3 . The  Navy  ICC  Model 

The  variables  and  equation  structures  for  the  Navy  LCC 
accounting  model  are  presented  in  Appendixes  G and  H,  and  a 
discussion  of  the  model  appears  in  Chapter  II.  It  has  no 
differentiating  characteristics  as  an  accounting  model  that 
prevent  it  from  being  subject  to  the  same  criticisms  as  the 
Air  Force  LSC  accounting  model.  However,  the  data  issue  offers 
some  promise  of  resolution  here,  because  the  Navy  VAMOSC  Mainte- 
nance Subsystem  can  provide  historical  data  on  analogous  air- 
craft subsystems  to  input  into  the  model. 

4 . The  CRIER  Accounting  Model 

This  model  was  developed  by  a panel  of  avionics  experts 
specifically  to  estimate  avionics  equipment  life  cycle  costs 
including  support  costs.  The  equations  are  more  numerous  and 
complex  than  those  in  the  AFLC  LSC  model  and  the  Navy  LCC  model.* 
The  equations  are  presented  in  an  excerpt  from  the  CRIER  users 
manual  in  Appendix  K.  They  cover  acquisition,  research  and 
development,  and  operating  and  support  costs.  This  makes  them 
more  extensive  in  coverage  than  the  AFLC-LSC  equations. 

D.  OTHER  SERVICE  MODELS  AND  APPROACHES 

Other  component  level  models  that  can  be  utilized  to  esti- 
mate some  elements  of  support  costs  include  the  LCOM  simulation 
model,  the  Navy  Level  of  Repair  Analysis  and  Air  Force  Optimum 
Repair  Level  Analysis  models,  and  the  MOD-Metrlc  type  spares 
models . 

*See  Table  7 in  Chapter  II  for  a listing  of  the  operating  and  si?3port  cost 
elements  for  which  separate  accounting  equations  exist  in  the  model, 
including  equations  for  replenishment  spares,  depot  labor  and  material, 
and  organization  and  intermediate  maintenance  in  several  categories. 
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J The  LCOM  simulation  maintenance  manpower  model  offers  a 

ii 

^ useful  methodological  approach  to  estimating  the  base  level 

maintenance  manpower  requirements  of  a weapon  system  under 
I development.  In  its  current  configuration  the  LCOM  is  a large 

model  that  requires  massive  input  specifications  for  the  opera- 
tional and  maintenance  environments  and  the  comparability 
analyses  of  specific  equipments,  including  avionics.  The  quali- 
fication that  must  be  made  to  the  use  of  the  model  is  that  it  is 
a complex  time-consuming  process  for  which  the  output  is  only 
one  of  several  elements  of  support  costs.  Nonetheless,  the  Air 
Force  is  currently  using  LCOM  simulations  on  all  new  aircraft 
programs . 

Level-of-repalr  models  like  ORLA  and  LORA  can  provide  the 
capability  to  determine  the  least  cost  level  of  repair  policy 
for  new  components  on  P-X  aircraft.  The  model  simply  adds  up 
the  various  costs  of  three  maintenance  alternatives  for  each 
line  replaceable  unit  (LRU)  on  a proposed  aircraft — discard  at 
failure,  repair  at  base,  repair  at  depot — and  then  identifies 
the  least  costly  for  each  LRU.  The  data  requlresments  for 
these  models  are  extensive,  although  it  is  possible  to  operate 
them  by  analogy  data.  The  usefulness  of  such  an  exercise  early 
in  the  acquisition  process  is  uncertain.  Given  two  competing 
maintenance  concepts  the  models  could  assist  in  producing  a 
least  cost  output,  but  the  magnitudes  of  the  analogy-derived 
costs  would  be  useful  only  as  comparative  trade-off  measures, 
not  as  point  estimates. 

Spares  Inventory  management  models  like  MOD-METRIC  can 
assist  in  reducing  the  number  of  spare  items  required  to  keep 
a system  operational.  These  models  can  determine  optimal 
spares  stock  levels  in  a multi-item,  multi-maintenance  echelon 
environment  for  recoverable  items.  The  heart  of  the  approach 
demands  substantial  data  and  systems  definition,  including  sub- 
assembly  removal  frequencies,  average  resupply  times,  NRTS 
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rates,  and  other  similar  detailed  inputs  by  detailed  seven-digit 
WUC  equipments.  The  models  can  operate  with  analogy  data  early 
in  the  acquisition  cycle  to  determine  the  impact  of  alternative 
maintenance  concepts  on  spares  requirements.  If  analogy  is  used, 
considerable  time  and  effort  are  required  to  accumulate  and  input 
the  requisite  data. 

E.  CONTRACTOR  ENGINEERING  APPROACHES 

The  fundamental  contractor  approach  of  engineering  build- 
up and  analogy  cost  es+^imates  for  acquisition  costs  is  unlikely 
to  be  useful  outside  tno  contractor  environment.  Engineering 
and  management  expertise  is  a cumulative  body  of  knowledge 
acquired  over  time  that  would  be  expensive  to  replicate  and 
difficult  to  maintain  outside  the  contractor  environment.  In 
addition,  the  outputs  of  these  approaches  are  acquisition  cost 
estimates  and  reliability  and  maintainability  estimates  which 
must  then  be  input  into  a support  cost  model.  As  a result, 
the  basic  contractor  approach  is  unique  to  the  contractor 
environment . 

F.  SUMMARY 

The  currently  available  versions  of  the  two  fundamental 
avionics  support  cost  estimating  methodologies,  regression  and 
accounting  models,  do  not  provide  useful  avionics  support  cost 
estimates  early  in  the  acquisition  cycle.  Data  system  limita- 
tions have  particularly  hampered  regression  model  developments. 
Accounting  models  have  been  of  little  use  early  in  the  acquisi- 
tion cycle  because  of  the  dual  effect  of  data  system  limitations 
and  the  requirements  for  substantial  data  detail.  Analogy  in- 
puts to  accounting  models  have  been  equally  hindered  by  the 
absence  of  reliable  comprehensive  data  bases. 

Other  estimating  models  attack  the  support  cost  problem 
piecemeal,  only  providing  estimates  of  a specific  support  cost 
category  at  substantial  costs  in  time  and  effort. 
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Chapter  V 

MODELING  APPROACHES  FOR  OSD 

A.  INTRODUCTION 

The  prior  chapters  present  a comprehensive  review  and 
evaluation  of  the  methodological  approaches  to  fighter  aircraft 
avionics  support  cost  estimating  that  are  currently  used  by  the 
Services  and  weapon  system  contractors.  These  approaches  differ 
significantly  in  data  requirements,  design  and  performance 
sensitivities,  and  degrees  of  accuracy.  They  also  differ  in 
another  Important  respect  that  is  relevant  to  the  assessment  of 


methodological  approaches  at  the  CAIG  level — whether  they  are 
primarily  suited  to  estimate  point  values  of  support  costs  or 
for  comparlsions  of  alternatives  in  trade-off  studies.  Briefly 


discussed  in  Chapter  I,  this  issue  is  critical  to  the  recommen- 
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datlons  of  specific  methodologies  and  approaches  useful  to  the 
CAIG,  and  as  a result  will  be  examined  in  greater  detail  here. 

Ideally  an  estimating  technique  should  be  able  to  produce 
cost  values  that  are  simultaneously  valid  for  both  point  cost 
and  trade-off  study  estimates.  None  of  the  current  Service  or 
contractor  techniques  possess  this  ideal  characteristic.  The 
difficulty  Inherent  in  using  a single  model  for  both  types  of 


estimates  is  that  the  point  and  trade-off  models  may  be  sensi- 


tive to  different  independent  variables 


For  a point  estimate  of  the  support  costs  for  a piece  of 
avionics  equipment  it  may  be  appropriate  for  an  estimating 
equation  to  focus  on  independent  variables  like  MTBP,  weight, 
and  volume  of  the  avionics  equipment.  By  examining  historical 


data  that  include  several  different  avionics  equipments  in  a 
single  functional  category,  like  radar  antennas,  we  may  be  able 
to  develop  estimating  relationships  between  cost  and  MTBF, 
weight,  volume,  and  so  on.  However,  if  we  wished  to  make  the 
source  selection  and  other  early  decisions  based  on  life  cycle 
costs,  we  would  require  independent  variables  that  would  permit 
us  to  discriminate  among  and  between  alternative  avionics  com- 
ponents. MTBF,  weight,  and  volume  would  likely  be  character- 
istics that  the  competing  avionics  contractors  would  have  to 
design  to.  If  all  designs  submitted  to  source  selection  are 
identical  with  regard  to  these  characteristics,  then  some  other 
set  of  variables  v^rould  have  to  be  identified  that  could  differ- 
entiate one  potential  radar  antenna  from  another  with  respect 
to  support  costs. 

The  capabilities  and  sensitivities  of  various  modeling 
approaches  were  treated  more  fully  in  Chapter  IV,  but  here  we 
are  concerned  with  the  fact  that  different  methodologies  and 
models  are  suited  for  different  purposes.*  These  differences 
require  us  to  recommend  that  the  CAIG  use  different  models  for 
point  estimating  and  trade-off  comparisons.^ 


*Thls  problem  is  not  unique  to  avionics  cost  estimating.  The  entire  economic 


theory  of  cost  abounds  with  discussions  of  the  difficulties  of  taking  micro 
(specific  piece  part  level  detail  in  avionics  equipnent)  data  and  expanding 
that  data  to  produce  macro  (total  avionics  system  and  total  we^on  system 
level)  data.  The  uncertainties  present  in  the  micro  data  make  the  expansion 
to  macro  data  difficult  if  not  Inpossible.  Theoretically  it  is  entirely 
possible  to  do  so,  but  practically  the  estimating  tools  and  techniques 
sinply  are  not  capable  of  making  the  transfer  from  mlrco  to  macro.  The 
uncertainties  in  the  data  introduce  what  is  sometimes  called  the  "fallacy 
of  conposltion"  in  going  frcm  micro  to  macro  data,  which  sinply  means  that 
the  functional  relationships  developed  for  the  micro  data  may  not  hold  when 
expanded  to  the  macro  level. 


^Electronic  versus  mechanical  antennas  of  the  same  aperture  provide  an  exanple 
of  the  requirements  of  different  models  for  different  independent  variables. 
Aperture  may  be  a reliable  variable  to  make  point  estimates  of  support  costs 
for  radar  antennas  over  a fifteen  year  life  cycle;  but,  if  the  apertures  of 
the  two  conpeting  antenna  deslgis  prior  to  source  selection  are  the  same 
because  they  were  designed  to  government  requirements,  then  aperture  cannot 
be  used  to  distinguish  between  the  two  designs.  (Continued  c»i  page  185). 
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B.  ESTIMATION  MODEL  1 (EMI ) 

An  estimation  model  that  would  be  useful  for  validating  the 
magnitude  of  support  cost  estimates  can  be  constructed  along  the 
lines  of  bottoms-up  and  analogy  estimates  used  by  contractors. 

EMI  is  a specific  application  of  this  bottoms-up  approach.  The 
model  is  described  in  terms  of  the  Navy  VAMOSC  Maintenance  Sub- 
system (MS)  component  equipment  data,  because  this  seems  to  be 
the  most  detailed  data  available.  Similar  component  level  data 
are  not  currently  available  in  Air  Force  data  systems,  including 
OSCER,  without  a substantial  analysis  and  gathering  effort.  The 
Navy  data  Include  base,  intermediate,  and  depot  level  manhour 
and  material  costs,  replenishment  spares,  and  spare  parts  support 
costs,  at  the  five-digit  WUC  level  of  detail. 

In  the  Navy  VAMOSC  MS  system,  avionics  equipments  down  to 
the  five-digit  level  are  identified  according  to  physical 
characteristics.  For  example,  the  AN/APR  25  radar  detector  set 
is  WUC  76660,  and  is  made  up  of  the  following  five-digit  WUC 
elements : 

(1)  analyzer,  WUC  76661 

(2)  azimuth  Indicator,  WUC  76662 

(3)  threat  display  unit,  WUC  76663 

(M)  preamplifier,  WUC  76664 

(5)  receiver  adapter,  WUC  76666 

(6)  filter,  WUC  76667 

(7)  Interference  blanker,  WUC  76668. 

These  elements  can  be  characterized  according  to  the 
following  kinds  of  categories  as  appropriate: 

(1)  power  levels  drawn  at  peak  and  off-peak  uses 

(2)  number  of  pieces 

(cont'd)  Some  other  variables  must  be  found  to  explain  the  differences 
between  the  two  deslgis,  variables  such  as  the  nuirber  of  antenna  elanents 
and  the  nunfcer  of  subconponent  interfaces  within  the  antennas. 


O 


(3)  weight,  volume,  density 

(4)  linkages  to  other  components 

(5)  number  of  geometric  elements  in  a frame 

(6)  scanning  rate. 

Using  this  bottoms-up  approach,  all  the  existing  five-digit  WUC 
equipments  can  be  identified  according  to  their  physical  charac- 
teristics and  established  as  a detailed  analogy  data  base. 

When  considering  the  avionics  suite  for  a new  proposed 
P-X  aircraft,  the  avionics  components  in  the  analogy  data  base 
that  are  most  like  the  components  in  the  proposed  F-X  suite  are 
identified,  and  in  effect  an  avionics  suite  is  bullt-by-analogy 
from  the  existing  data  base  of  avionics  equipments.  Engineering 
advice  may  be  required  in  constructing  the  analogy  avionics 
suite  since  the  decisions  as  to  which  equipments  from  the  data 
base  are  appropriate  analogies  are  largely  technical  engineering 
decisions . 

The  next  step  is  to  price  out  the  support  costs  of  the  list 
of  items  that  make  up  the  analogy  P-X  avionics  suite,  and  this 
can  be  accomplished  by  examining  the  VAMOSC  MS  historical  data 
for  those  existing  equipments.  For  equipments  that  represent 
an  extension  of  or  are  more  technologically  advanced  than  an 
existing  component,  each  individual  equipment  characteristic 
must  be  examined.  Each  characteristic  (power,  weight,  scanning 
rate,  etc.)  must  be  related  to  maintenance  cost  and  spares 
requirements.  Relationships  such  as  these  can  be  developed 
through  the  seven-digit  VAMOSC  data  base,  but  this  will  take 
engineering  Judgment  as  well  as  computational  effort.  For  a 
new  avionics  component  for  which  there  are  no  analogies  in  the 
Judgment  of  the  engineers,  special  analyses  would  have  to  be 
done.  In  the  opinion  of  avionics  experts  at  the  various  con- 
tractor firms  we  visited,  there  is  little  in  the  way  of  avionics 
equipment  that  is  so  radically  new  that  an  appropriate  analogy 
equipment  cannot  be  found  for  it. 
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The  analysis  technique  described  above  could  be  utilized 
at  a high  level  of  WUC  aggregation,  say  the  two-digit  level, 
for  grosser  estimating.  Thus,  an  entire  two-digit  avionics 
equipment  would  be  described  by  physcial  characteristics, 
related  to  support  costs  in  the  VAMOSC  MS  report,  and  would 
constitute  an  element  in  a two-digit  analogy  data  base. 

This  EMI  model  is  based  on  the  following  logical  assump- 
tions : 

(1)  Avionics  can  be  viewed  as  a set  of  functions  to  be 
performed,  and  this  set  is  relatively  constant  over 
time.  Although  specific  equipments  to  perform  a 
function  may  change,  the  function  remains. 

(2)  Existing  sets  of  equipments  currently  perform  these 
functions  and  can  be  used  as  analogy  building  blocks 
with  which  to  construct  a proposed  avionics  suite 
for  an  P-X  aircraft. 

(3)  Engineering  technology  is  understood  by  avionics 
experts,  and  any  proposed  technological  advances 
are  well  integrated  into  the  experts'  understanding 
and  perceptions.  Experts  therefore  can  make  rea- 
soned Judgments  about  appropriate  analogies  and 
deviations  from  the  current  system. 

(^)  Through  the  EMI  process  we  can  build  a new  avionics 
suite  on  paper,  then  price  its  support  for  mainte- 
nance and  replenishment  spares  through  the  data 
potentials  in  the  VAMOSC  MS  systems.  The  bottoms-up 
approach  is  the  procedure  contractors  use  for  pre- 
paring acquisition  cost  proposals,  and  is  the  pro- 
cess that  can  be  used  to  develop  support  costs  if 
given  the  VAMOSC  data  for  all  possible  equipments. 

The  advantage  that  OSD  has  over  the  contractors  in 
this  respect  is  considerable,  because  the  data  avail- 
ability is  substantially  greater  in  the  area  of 
support  costs  for  OSD  than  for  contractors. 

(5)  This  procedure  can  be  used  for  DSARC  0,  I,  II,  or  III, 
or  any  other.  The  difference  among  uses  at  different 
DSARC  milestones  is  that  greater  uncertainty  is 
Inherent  in  the  support  cost  estimates  the  earlier  in 
the  process  you  begin.  At  DSARC  0 or  I you  may  be 
workin;^  at  the  two-digit  WUC  level,  while  later  the 
level  may  expand  to  five-digit  WUCs,  if  desired. 

(6)  There  is  nothing  that  is  novel  about  the  methodology 
of  this  approach,  it  has  been  the  basis  for  contractor 
acquisition  cost  estimates  for  many  years.  The 
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(6)  availability  of  support  cost  data  at  the  detailed 
WUC  level  in  the  Navy  VAMOSC  is  new,  however,  and 
this  is  what  makes  this  approach  a potential  that 
will  exceed  the  contractor  support  cost  estimatinp; 
capabilities  in  the  bottoms-up  or  analogy  mode. 

C.  ESTIMATION  MODEL  2 (EM2) 

An  estimating  model  for  avionics  support  costs  that  could 
be  termed  the  "traditional"  approach  is  to  prepare  avionics 
regression  equations  that  have  support  costs  as  the  dependent 
variables  and  acquisition  costs  as  the  independent  variables, 
perhaps  with  MTBP  as  an  additional  Independent  variable. 

Although  "traditional"  in  the  sense  that  such  equations  have 
been  attempted  before,  the  results  have  not  been  fruitful.  How- 
ever, given  one  conceptual  assumption,  the  reason  that  the 
traditional  approach  has  not  been  fruitful  previously  lies  in 
the  inadequacy  of  historical  data,  not  in  the  inadequacy  of  the 
analytical  methodology. 

The  conceptual  assumption  that  must  be  made  is  that  support 
costs,  maintenance  at  all  levels,  and  spares  and  repair  parts 
support,  are  a function  of  acquisition  costs.  Thus  the  funda- 
mental equation  we  hypothezie  as  representing  support  costs 
is,  for  a maintenance  cost  example, 

Y = f(X^)  , 

where:  Y = annual  maintenance  cost  of  a two-digit  WUC 

avionics  equipment 

X-]^  = acquisition  cost  of  the  two-digit  WUC 
avionics  equipment. 

This  is  exactly  the  form  of  equation  utilized  in  the  recent 
General  Research  Corporation  work  done  for  the  Air  Force 
Avionics  Laboratory.  As  explained  in  Chapter  IV  earlier,  they 
based  their  data  on  the  Air  Force  IROS  system,  which  is  defi- 
cient as  explained  in  Chapter  II.  However,  the  availability  of 
Navy  VAMOSC  Maintenance  Subsystem  data  presents  the  opportunity 
to  replicate  the  GRC  approach  with  more  complete  maintenance  data. 
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The  assumption  that  support  costs  are  a function  of  acquisl 
tion  costs  is  based  on  a further  assumption  that  acquisition 
costs  are  adequate  proxies  for  the  real  physical  design  and 
performance  characteristics  that  are  the  real  support  cost  dri- 
vers. Given  this  assumption  as  valid,  the  simple  tradlonal 
regression  approach  may  be  acceptable.  What  it  is  acceptable 
for  is  the  point  estimation  of  avionics  support  costs;  that  is, 
an  estimate  of  the  actual  dollar  value  of  future  support  costs. 
However,  the  simple  Independent  variable  of  acquisition  costs 
provides  little  discriminatory  power  between  or  among  alterna- 
tive avionics  systems.  The  addition  of  another  Independent 
variable  like  MTBF,  expanded  fundamental  equation 

below,  seems  to  add  little  explanatory  power  in  the  equations 
pursued  in  the  literature. 

Y = f(X^X2) 

where:  Y = annual  maintenance  cost  of  a two-digit  WUC  avionics 

equipment 

X^  = acquisition  cost  of  the  two-digit  WUC 
^2  - mean  time  between  failure. 

However,  the  detailed  Navy  VAMOSC  data  offer  potential  estimat- 
ing equations  with  enough  uniqueness  to  discriminate  among 
systems . 

The  approach  is  to  continue  to  utilize  acquisition  cost  as 
the  prime  independent  variable;  however,  separate  estimating 
equations  are  produced  for  base,  intermediate,  and  depot  mainte- 
nance and  replenishment  spares,  for  each  two-digit  WUC  equipment 
The  costs  of  these  categories  are  available  in  the  VAMOSC  system 
Each  of  the  costs  becomes  a dependent  variable  in  a set  of  esti- 
mating equations.  Historical  data  for  avionics  two-digit  WUC 
equipments  are  collected  for  each  cost  category,  then  regressed 
against  acquisition  costs  and  MTBF  or  BCM  rates.  This  approach 
disaggregates  the  dependent  variable  for  maintenance  costs. 

With  a separate  equation  calculated  for  each  maintenance  cost. 
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the  uniqueness  of  the  base.  Intermediate,  and  depot  maintenance 
relationships  can  be  captured  In  the  coefficients  of  the  regres- 
sion equations.  When  combined  Into  a single  maintenance  cost, 
these  unique  relationships  are  masked  and  perhaps  lost. 

During  the  acquisition  phases  prior  to  DSARC  0 or  DSARC  I 
phases  of  acquisition,  when  cost  estimates  are  at  an  early  level 
and  MTBFs  not  yet  specified  In  most  cases,  an  OSD  analyst  equip- 
ped with  three  maintenance  equations  for  WUC  72  could  engage  In 
the  following  analysis.  Fix  the  MTBF  of  the  avionics  equipment 
at  one  value,  perhaps  the  one  desired  by  the  sponsoring  Service, 
or  the  suggested  Improvement  over  the  old  WUC  72  system,  and 
Insert  alternative  acquisition  costs  Into  the  three  maintenance 
equations,  one  for  organization,  one  for  Intermediate,  and  one 
for  depot  level  maintenance.  This  would  provide  a range  of 
maintenance  support  costs.  Contractor  estimates  could  Immedi- 
ately be  checked  to  see  If  they  are  In  the  relevant  ranges. 

Because  the  maintenance  costs  are  disaggregated  Into  three  com- 
ponents, the  sensitivity  of  each  element  of  maintenance  costs 
could  be  elevated.  A high  acquisition  cost  might  produce 
relatively  high  organization  and  intermediate  costs  but  low  depot 
costs,  while  a low  acquisition  cost  might  produce  relatively  high 
depot  costs  but  low  Intermediate  and  organization  costs.  The 
sum  of  the  three  elements  would  yield  a total  maintenance  cost 
that  could  permit  better  discrimination  among  alternative  avionics 
systems  than  a single  equation  for  total  maintenance  costs  that 
did  not  reflect  the  different  relationships  at  different  mainte- 
nance levels.  This  would  have  to  be  tested,  but  the  possibility 
exists  that  this  traditional  approach,  combined  with  VAMOSC 
detailed  data,  could  yield  not  only  Improved  point  estimation 
models,  but  also  Improved  trade-off  discrimination  models. 

D.  ESTIMATION  MODEL  3 (EM3) 

A specific  analogy  WUC  regression  model  would  combine  ele- 
ments of  the  bottoms-up  EMI  approach  and  the  traditional  EM2 
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approach.  The  procedure  would  be  to  first  establish  an  avionics 
data  base  that  contains  physical  data  characteristics  of  avionics 
equipment — size,  weight,  number  of  parts,  and  so  on.  Through 
the  VAMOSC  maintenance  subsystem  in  the  Navy,  detailed  cost  data 
are  available  for  specific  pieces  of  avionics  equipment.  Given 
the  physical  characteristics  data  and  the  avionics  support  cost 
data,  it  becomes  possible  to  run  regressions  on  selected  pieces 
of  avionics  equipments  with  organization,  intermediate,  and 
depot  level  maintenance  costs,  and  replenishment  spares  costs ^ 
as  dependent  variables,  and  physical  equipment  characteristics 
as  independent  variables.  These  physical  characteristics  are 
assumed  to  be  the  actual  cost  drivers  behind  equipment  support 
costs . 

To  use  these  data  bases  as  analogy  parametric  data  bases, 
the  following  procedure  is  followed.  Assume  a new  F-X  aircraft 
is  to  have  an  avionics  suite  composed  of  equipments  that  per- 
form identifiable  avionics  functions.  These  functions  can  be 
identified  by  the  two-digit  WUC  categories.  Take  any  one  of 
the  two-digit  WUCs,  such  as  WUC  71 j radio  navigation  equipment. 

An  engineer  or  other  knowledgable  person  can  select  various 
equipments  from  the  physical  characteristics  data  base  that  are 
the  closest  analogies  to  the  F-X  WUC  71  equipment.  Then,  the 
support  costs  for  these  closest  analogy  equipments  can  be 
extracted  from  the  VAMOSC  MS  data  base.  Now,  regression  equa- 
tions peculiar  to  the  new  F-X  WUC  71  requirement  can  be  produced, 
using  the  physical  characteristics  from  the  physical  data  base 
as  Independent  variables  and  the  Navy  VAMOSC  MS  cost  data  as 
dependent  variables.  By  combining  analogies  selected  by 
engineering  expertise,  with  parametric  estimating  techniques, 
a set  of  equations  can  be  tailored  to  the  requirements  of  the 
new  F-X  aircraft. 

This  tailoring  capability  is  the  unique  and  promising  fea- 
ture of  this  approach.  Each  time  a new  F-X  aircraft  is  proposed, 
a new  set  of  closest  analogy  regression  equations  can  be  produced 
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from  the  data  bases.  This  introduces  flexibility  into  the 
usually  static  regression  technique. 


The  construction  of  the  avionics  physical  characteristic 
data  base  is  obviously  a critical  assumption  for  the  development 
of  this  technique.  Another  important  assumption  is  the  avail- 
ability of  WUC  data  at  the  specific  equipment  level.  As 
explained  earlier  in  Chapter  II,  these  data  are  currently  avail- 
able in  the  Navy.  To  maintain  the  maximum  flexibility  of  this 
approach,  the  data  bases  would  need  to  be  updated  as  new  equip- 
ments Joined  the  inventory.  This  updating  should  be  a small 
recurring  task  once  the  initial  data  bases  are  constructed. 

This  tailored  analogy  regression  model  approach  should 
provide  both  point  estimates  and  trade-off  estimates  of  con- 
siderable validity  at  DSARC  0,  I,  and  II.  Initially,  the 
physical  characteristics  as  Independent  variables  would  provide 
a trade-off  capability  between  alternative  avionics  equipments. 
As  the  equipments  become  more  and  more  defined,  the  equations 
can  serve  equally  well  as  point  estimators  for  validation  and 
verification  of  will-cost  estimates.  In  addition,  if  two  alter- 
native radio  devices  were  at  issue  for  WUC  71  on  the  F-X  air- 
craft, two  different  regression  equations  could  be  constructed, 
one  for  each  alternative  that  was  most  closely  approximated  by 
analogous  equipment  from  the  data  bases.  Then,  the  support 
costs  could  validly  be  compared  because  the  equations  for  each 
alternative  would  have  been  developed  from  the  oame  homogeneous 
data  bases.  As  both  a point  and  a trade-off  estimating  tech- 
nique, the  analogy-parametric  approach  is  promising. 

E.  ESTIMATION  MODEL  4 (EM4) 

The  APLC  Logistic  Support  Cost  Model,  and  other  accounting 
models  like  it  (Navy  LCC,  CRIER),  provide  viable  alternatives 
for  support  cost  estimates.  The  difficulty  usually  cited  is 
that  substantial  detail  is  required  to  process  the  model's 
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! equations  that  are  rich  in  data  requirements  at  the  FLU  level.* 

i Although  the  data  requirement  is  a consideration  in  using  LSC, 

I it  is  not  one  that  presents  unmanageable  difficulties  even  at 

|i  DSARC  0 and  I. 

i Analogy  again  provides  a technique  that  can  permit  the 

model  to  function.  By  using  data  on  analogous  systems,  the  J 

great  detail  of  the  LSC  model  can  be  provided  at  any  time  during  ' i\ 

i:  I 1 

[ the  acquisition  process.  1; 

i i i 

I'  F.  ESTIMATION  MODEL  5 (EM5) 

The  LSC  model  could  be  adapted  to  parametric  regression  use 
by  turning  its  basic  equations  into  regressions  and  obtaining 
historical  data  on  each  variable.  Again,  analogy  to  existing 
systems,  based  on  expert  enginerring  Judgment,  would  select 
. analogous  equipments  to  the  F-X  avionics  suite.  The  development 

of  a massive  data  base  would  again  facilitate  the  quick  response 
• character  of  this  alternative  approach. 

To  take  the  example  of  how  the  process  would  be  implemented, 
we  can  examine  spares  costing  for  replenishment  spares.  Similar 
approaches  would  be  taken  for  maintenance  and  any  other  desired 
support  costs  for  which  LSC  equations  exist. 

The  approach  to  spares  costing  suggested  here  it  to  take 
the  AFLC  LSC  model  spares  equation,  obtain  historical  data  on 
existing  aircraft  components  to  Insert  into  the  equations,  cal- 
culate spares  costs  for  each  two-digit  WUC,  then  regress  these 
costs  against  the  values  of  the  variables  in  the  equations  and 
obtain  regression  coefficients  which  can  then  be  used  to  compute 
spares  costs  for  proposed  systems  in  conceptual  stages. 

The  LSC  replenishment  spares  equation  for  the  cost  of 
spares  (C)  for  a single  FLU  is  given  below. 


*See  Chapter  II  for  a discussion  of  the  LSC  model's  conplex  equations  and 
data  requirements. 
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(UC) 


(TFFH) (OPA) (UF) (1-RIP) (COND) 
MTBF 


where:  TFFH 

QPA 
UF 

1-RIP 

COND 

UC 

MTBF 


total  force  flying  hours 

number  of  like  FLUs  in  parent  system 

ratio  of  operating  to  flying  hours 

fraction  of  failed  FLUs  not  repaired  in  place 

condemnations 

initial  provisioning  cost 

meantime  between  failure 


Each  variable  above  is  available  in  historical  data  systems  for 
existing  equipment.  By  regressing  the  calculated  replenishment 
spares  cost  C against  what  the  LSC  model  uses  as  the  explanatory 
variables,  we  hypothesize  that  the  LSC  model  equation  does  in 
fact  capture  the  relevant  influence  on  replenishment  spares 
cost.  Individual  data  points  are  provided  by  calculating  C for 
various  pieces  of  two-digit  WUC  equipment,  say  WUC  72,  radar 
navigation  equipment. 

One  advantage  of  such  an  approach  is  that  a separate 
regression  equation  can  be  calculated  for  each  two-digit  WUC 
equipment  category.  The  obvious  disadvantage  is  obtaining  values 
of  the  variables  for  the  proposed  conceptual  stage  equipment. 

But  this  is  a manageable  problem.  The  values  for  TFFH  and  UF 
will  be  provided  at  DSARC  I in  the  preliminary  WSPD.  QPA  drops 
out  of  this  equation  when  the  equation  is  used  at  the  two-digit 
WUC  level  because  there  is  only  one  two-digit  WUC  equipment  of 
category  72  on  an  aircraft,  thus  QPA  is  equal  to  unity  here. 

RIP  could  be  used  as  a boundary  factor  setting  limits  to  the 
repalred-in-place  experience;  that  is,  the  equation  could  be 
run  with  RIP  = 0 to  establish  one  boundary,  and  with  RIP  = 0 
or  1 to  establish  another  boundary.  This  setting  RIP  = 0 or  1 
could  also  serve  as  a way  of  introducing  a maintenance  concept 
into  the  equation,  if  the  maintenance  concept  were  to  repair 
either/or  all  or  more  of  the  equipment  in  place.  COND  and  MTBF 


would  be  the  most  difficult  equation  values  for  the  proposed 


conceptual  system,  but  these  too  can  be  handled.  COND  can  be 
developed  as  a factor  based  on  the  experience  with  the  equip- 
ments used  in  the  regression  data  base.  MTBF  can  either  be 
specified  in  the  DSARC  I MENS  as  a goal  to  be  achieved  by  con- 
tractors, it  can  be  factored  from  historical  experience,  or  it 
can  be  factored  and  have  an  "up-grading"  applied  to  it  by 
engineering  experts  either  at  OSD  or  in  the  Services . 

G.  ESTIMATION  MODEL  6 (EM6) 

The  RCA  PRICE  model  has  a new  life  cycle  cost  capability 
that  could  provide  an  alternative  approach  to  support  costing. 
Conceptually  inexpensive  in  that  the  model  theorizing  is  already 
accompllsehd  and  buried  within  the  proprietary  interior  of  the 
equations,  the  PRICE-L  life  cycle  cost  model  provides  a quick 
response  tool.  As  discussed  in  Chapter  III,  the  model's  outputs 
are  not  in  standard  support  cost  categories;  instead,  the  model's 
outputs  can  serve  as  inputs  to  other  conventional  modeling 
approaches,  such  as  the  LSC  or  other  accounting  models. 


H. 


SUMMARY 


Table  27  displays  the  various  approaches  discussed  here. 
Several  modeling  approaches  are  available  for  avionics  support 
cost  estimating  at  DSARC  0,  I,  and  II.  Ranging  from  the 
bottoms-up  analogy  approach  that  relies  heavily  on  engineering 
expertise  to  the  RCA  PRICE-L  that  relies  on  unknown  proprietary 
equations,  these  approaches  are  varied  in  their  techniques  and 
requirements.  The  techniques  that  mose  closely  approximate  the 
contractor  bottoms-up  approaches  are  EMI,  an  engineering  analogy 
technique,  and  EM3,  a specific  analogy  WUC  regression  model.  It 
is  clear  that  analogies  to  existing  systems  provide  the  closest 
approximation  to  the  contractor  approaches. 


195 


The  most  economical  approaches  in  terms  of  computation 
time  and  set  up  time  would  be  the  EM2  traditional  regression 
equations  and  the  PRICE-L  model.  Finally,  the  LSC  accounting 
model  approaches  provide  elements  of  both  analogy  estimating 
in  the  EM4  model,  and  regression  estimating  in  the  EM5  model. 
Both  however  do  require  considerable  data,  but  the  data  can  be 
obtained  by  analogy  and  used  throughout  the  early  stages  of 
the  acquisition  process. 
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®7.  SUMMARY  OF  SUGGESTED  MODELING  APPROACHES  FOR  OSD-LEVEL 
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Analytical  Support 

Lowest  Level  of 

Detail  in  Model 

Useful  for  Point  or 
Trade-Off  Cost  Estimates 
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Itial  analysis  and  then 
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Not  feasible  - t 

— 1 

tial  analysis  of 
sting  historical  data 

e 

2-Digit  WUC  Equipments 

Poi  nt 

Feasible  after  i 
research  to  deva 
suitable  data  ba 
equations 

^ 

tial  engineering 
lysis  and  then 
tinual  engineering 
port  input  to  update 
a base 

7-Digit  WUC  Equipments 

Point  and  Trade-off 

Feasible  after  i 
research  to  devi 
suitable  data  b( 
equations 

— . 

lytical  support  to 
cess  massive  data 
uts 

7-Digit  WUC  Equipments 
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2-Digit  WUC  Equipments 

Point  and  Trade-off 

Feasible  after  i 
the  basic  model 

tial  training  of  model 
rator,  same  operator 
uired  to  input  data 

7-Digit  WUC  Equipments 

Point  and  Trade-off 

Feasible  but  va 
outputs  very  un< 

ons  are  unknown  to  the  model  user.  Only  RCA  knows  the  equations.  This  prohibits  the  user  from  assessing  the  fui 
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[STED  MODELING  APPROACHES  FOR  OSD-LEVEL 


P-- 

L - 

Lowest  Level  of 

Detail  In  Model 

— ^ — 

Useful  for  Point  or 
Trade-Off  Cost  Estimates 

Feasibility  for  use  at  OSD 

r 

7-D1git  WUC  Equipments 

Point  and  Trade-off 

Not  feasible  - too  detailed 

L 

2-Dig1t  WUC  Equipments 

Pol  nt 

Feasible  after  Initial 
research  to  develop 
suitable  data  base  and 
equations 

n 

s 

7-Dig1t  WUC  Equipments 

Point  and  Trade-off 

Feasible  after  initial 
research  to  develop 
suitable  data  base  and 
equati ons 

7-D1g1t  WUC  Equipments 

Point  and  Trade-off 

Not  feasible  - too  detailed 

2-Dig1t  WUC  Equipments 

Point  and  Trade-off 

Feasible  after  establishing 
the  basic  model 

1 

7-D1g1t  WUC  Equipments 

Point  and  Trade-off 

Feasible  but  validity  of 
outputs  very  uncertain 

Mel  user.  Only  RCA  knows  the  equations.  This  prohibits  the  user  from  assessing  the  functional 
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Chapter  VI 

SUMMARY  AND  CONCLUSIONS 

A.  INTRODUCTION 

In  the  preceding  chapters,  we  have  discussed  Service  and 
contractor  methods  for  developing  avionics  component  support 
cost  estimates.  We  placed  particular  emphasis  on  the  methods 
appropriate  to  estimating  support  costs  early  in  the  acquisi- 
tion cycle.  These  methods  differ  widely  in  their  treatments 
of  the  pervasive  problems  of  uncertainty  that  characterize 
all  cost  estimating  techniques,  ranging  from  the  experienced 
expert  Judgments  of  design  and  reliability  and  maintainability 
engineers  at  the  contractor  level  to  the  highly  aggregated 
program  factors  and  regression  equations  used  by  the  Air  Force 
and  Navy.  We  presented  our  evaluations  of  these  methods  aixu 
discussed  six  modeling  methodologies  that  OSD  should  consider 
in  deciding  upon  an  approach  to  use  for  early  acquisition 
cycle  avionics  component  support  cost  estimates.  We  conclude 
that  it  is  feabile  for  avionics  and  airframe  contractors,  the 
Services,  and  OSD  to  estimate  these  costs  early  in  this  cycle. 

Before  preceding  further,  we  should  restate  that  we  assumed 
OSD  has  two  major  needs  that  require  an  avionics  component  sup- 
port cost  estimating  capability.  First,  OSD  should  have  the 
tools  to  Independently  evaluate  the  support  costs  estimates  that 
are  presented  to  them  by  the  Services  at  the  various  milestones 
in  the  DSARC  process.*  This  need  for  Independent  OSD  evaluations 

* "Independence  is  a relative  tern,  because  all  the  cost  estimates  made  for 
specific  equipments  must  rely  on  coninon  data  (continued  on  page  200) 
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raises  several  issues  that  require  resolution  as  part  of  our 
final  assessment  of  the  feasibility  of  making  component  support 
cost  estimates  for  avionics  equipments  at  the  OSD  level.  These 
issues  are: 

(1)  Using  current  methodologies,  can  the  Services  make 
and  submit  component  support  cost  estimates  earlier 
in  the  acquisition  cycle  than  they  do  now? 

(2)  As  necessary  supporting  Inputs  to  the  Service  esti- 
mates, can  the  contractors  make  and  submit  component 
support  cost  estimates  earlier  in  the  acquisition 
cycle  than  they  do  now? 

(3)  Finally,  if  the  Services  and  contractors  are  capable 
of  making  and  submitting  these  estimates  as  early  as 
DSARC  0 and  I,  are  there  tools  potentially  available 
to  OSD  to  evaluate  these  estimates? 

The  second  major  OSD  need  is  for  making  trade-off  analyses 
between  and  among  alternative  equipment  designs  and  configura- 
tions. This  need  also  raises  several  Issues  that  require 
resolution  as  part  of  our  feasibility  determination: 

(1)  Can  trade-off  studies  be  conducted  for  the  total  life 
cycle  costs  of  Individual  equipments,  including  the 
support  costs  for  maintenance  at  all  levels  and 
spares  and  repair  parts  support? 

(2)  Is  OSD  required  to  depend  upon  the  Services  for  trade- 
off analyses  because  the  tools  cannot  be  developed  at 
the  OSD  level? 

As  a result  of  the  research  reported  in  Chapters  I through 
V,  we  concluded  that  avionics  support  cost  estimating  is  feasi- 
ble at  the  OSD  level  to  meet  both  the  needs  for  Independent 
evaluations  and  for  trade-off  studies,  and  we  resolved  each  of 
the  Issues  raised  by  these  needs  as  follows: 

(1)  The  Services  can  make  and  submit  avionics  component 
support  cost  estimates  prior  to  DSARC  II  and  as  early 
as  DSARC  I and  0 using  current  methodologies.  Pew  of 

(cont'd)  reporting  systems.  The  Independence  referred  to  here  is  relative 
to  the  assunptions  of  the  models  and  adjustments  of  the  data  that  go  into 
the  models.  In  these  senses,  it  is  possible  for  OSD  to  develop  "indepen- 
dent” estimates. 
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the  Services  estimating  techniques  are  inappropriate 
for  Implementation  earlier  than  now  performed. 

(2)  The  contractors  can  make  and  submit  component  support 
cost  estimates  as  early  as  they  are  required  to  do  so, 
including  the  conceptual  study  stage  prior  to  DSARC  0, 
if  desired.  These  contractor  estimates  are  grounded 
firmly  in  the  accumulated  experience  of  the  design 
and  reliability  and  maintainability  engineers  in  the 
various  companies,  and  as  a result  provide  a potential 
foundation  upon  which  the  Services’  estimates  can  be 
built  by  using  the  contractor  Judgments  and  modeling 
outputs  as  inputs  into  the  Service  methods. 

(3)  The  availability  of  tools  for  avionics  support  cost 
estimating  at  the  contractor  and  Service  levels  is 
evidence  that  tools  can  be  available  at  the  OSD  level. 
Given  various  levels  of  resource  commitment  by  OSD, 
there  is  no  doubt  that  various  estimating  tools  can  be 
exercised  at  the  OSD  level. 

(4)  Trade-off  studies  can  be  conducted  for  life  cycle 

I costs,  including  maintenance  and  spares  support  costs, 

for  individual  avionics  equipments  and  functions.  The 
prime  requirement  for  maintenance  and  spares  support 
costs  trade-off  analyses,  whether  at  the  contractor. 
Service,  or  OSD  levels,  is  for  consistent  cost  data. 

The  tools  for  trade-off  analyses  exist,  it  is  the 
availability  of  cost  data  that  inhibits  trade-off 
analyses . 

(5)  Because  trade-off  methodologies  exist  at  the  contrac- 
tor and  Service  levels,  the  methodologies  can  be 
adopted  for  use  at  the  OSD  level. 

Given  the  feasibility  of  meeting  the  OSD  needs  for  avionics 
component  support  cost  estimates,  and  given  the  resolution  of 
the  various  issues  raised  by  these  needs,  it  is  important  to 
recognize  that  the  degree  of  sophistication  of  the  tools  finally 
adopted  by  OSD  depends  upon  the  OSD  commitment  to  including 
life  cycle  costs  as  important,  sometimes  controlling,  variables 
in  the  decision-making  on  new  major  system  acquisitions.  In 
the  course  of  our  research  interested  personnel  in  the  Services 
and  contractor  firms  consistently  stated  that  a major  OSD 
decision  based  on  a balanced  appraisal  of  full  life  cycle  costs 
for  a major  weapon  system  would  go  a long  way  toward  enforcing 
support  cost  discipline  throughout  the  acquisition  cycle. 
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Given  a clear  OSD  decision  based  on  life  cycle  costs,  the 
degreee  of  sophistication  of  the  final  tools  that  could  be 
adopted  by  OSD  to  independently  estimate  support  costs  and  to 
conduct  trade-off  studies  could  be  considerable.  The  basic 
data  and  documentation  would  be  flowing  through  the  contractor 
and  Service  costs  estimating  methodologies  and  would  provide, 
over  time,  a body  of  culmulative  evidence  that  could  be  used 
to  refine  and  extend  the  OSD  capabilities. 

The  evidence  at  the  contractor  and  Service  levels  is  that 
equipment  level  support  cost  estimating  methodologies  are  inter- 
active and  mutually  supporting.  Currently,  OSD  is  out  of  the 
loop  of  this  interaction  prior  to  DSARC  II  because  equipment 
level  support  cost  estimates  are  not  considered  in  DSARC  0 and 
I decisions.  As  discussed  elsewhere  in  this  paper,  design 
decisions  made  in  the  conceptual  stages  long  before  DSARC  II 
commit  seventy  to  eighty  percent  of  life  cycle  support  costs 
for  a weapon  system  and  its  components.  Thus,  if  OSD  is  to 
have  an  Influence  on  the  majority  of  weapon  system  support 
costs  through  DSARC  decisions,  it  must  develop  a capability  to 
evaluate  support  costs  at  the  equipment  level  before  DSARC  II. 

Regardless  of  the  specific  support  cost  estimating  techni- 
ques employed,  estimates  prepared  early  in  the  acquisition 
cycle  embody  large  uncertainties.  The  decision  on  a specific 
cost  estimating  technique  to  adopt  at  the  OSD  level  depends 
largely  on  the  amount  of  resources  OSD  is  willing  to  invest  to 
minimize  these  uncertainties.  In  turn,  the  willingness  to 
commit  resources  to  component  support  cost  estimating  is  in 
large  part  a function  of  the  extent  to  which  component  support 
cost  estimates  will  affect  the  final  decisions  on  major  weapon 
or  avionic  system  acquisitions.  The  admitted  existence  of 
large  uncertainties  in  early  acquisition  cycle  cost  estimates 
should  not  be  interpreted  as  evidence  that  such  estimates 
cannot  be  made  managable  in  terms  of  their  predictive  accuracy. 
Cost  estimating  techniques  that  Involve  explicit  measures  of 


uncertainty  provide  a means  for  placing  the  degree  of  uncer- 
tainty attached  to  a support  cost  estimate  in  perspective. 

In  the  following  sections  we  present  our  conclusions  on 
techniques  that  OSD  should  develop  and  use  to  cope  with  its 
two  major  needs  for  avionics  support  cost  estimates.  As  dis- 
cussed in  earlier  chapters,  we  believe  it  is  quite  feasible  to 
develop  estimating  techniques  that  could  be  employed  at  all 
stages  of  the  DSARC  process.  This  is  confirmed  by  the  existence 
of  a variety  of  such  techniques  at  the  contractor  and  Service 
levels.  The  decisions  on  which  techniques  to  develop  depend 
on  the  degree  of  uncertainty  the  user  is  willing  to  accept  in 
the  outputs  of  the  estimating  methodology  as  reflected  by  the 
amount  of  resources  committed  to  the  techniques  developed. 

B.  POINT  ESTIMATE  METHODS  FOR  OSD  USE  AT  THE  DSARC  0 MILESTONE 

This  section  addresses  methods  to  be  used  very  early  in 
the  system  development  cycle,  prior  to  the  publication  of  an 
operational  requirement  document  (DSARC  0).  It  is  doubtful  if 
OSD  would  undertake  individual  component  trade-off  analyses 
this  early  in  the  system  acquisition  cycle;  therefore,  avionics 
support  cost  estimating  at  the  two-digit  WUC  level  should  be 
adequate.  Furthermore,  we  believe  that  the  basic  support  cost 
estimating  approaches  could  be  the  same  for  DSARC  0 and  DSARC  I 
although,  as  discussed  below,  some  capabilities  may  exist  at 
DSARC  I to  develop  better  estimates  than  at  DSARC  0. 

1 . Tools  to  Provide  Minimum  Required  OSD  Capability 

The  EM2  model  offers  the  greatest  promise  as  a method  to 
satisfy  the  DSARC  0 requirement.  This  model  has  the  advantage 
of  simplicity  and  after  suitable  equations  have  been  developed 
it  should  be  inexpensive  to  use  and  to  maintain.  The  model 
outputs  would  contain  relatively  high  degrees  of  uncertainty, 
but  the  values  should  be  sufficiently  accurate  to  support  the 
kind  of  decision  that  OSD  must  make  at  DSARC  0. 


203 


Although  considerable  uncertainty  in  output  values  must  be 
accepted  with  this  model,  a substantial  effort  should  be  devoted 
to  the  preparation  of  a suitable  historical  data  base  and  con- 
duct of  regression  analyses  to  develop  reasonable  equations. 

The  Navy  VAMOSC  data  base  with  data  through  FY  1977  should  be 
suitable  for  first  stage  work  in  developing  an  EM2  type  model. 

A preliminary  model  probably  could  be  developed  with  the  exist- 
ing data  base  that  contains  Information  only  through  FY  1976. 

Our  research  indicates  that  the  analysts  who  develop  the 
OSD  EM2  model  would  be  unable  to  find  a comparable  data  base 
readily  available  for  the  Air  Force.  However,  it  should  be 
possible  to  create  an  acceptable  Air  Force  data  base  by  using 
the  Information  available  in  several  AFLC  data  systems.  The 
current  Air  Force  VAMOSC  system  (OSCER)  is  not  acceptable  for 
the  EM2  model  partially  because  it  does  not  provide  avionics 
support  cost  Information  at  the  two-digit  WUC  level. 

2 . Tools  to  Provide  Enhanced  OSD  Capability 

An  enhanced  OSD  capability  could  be  provided  by  the 
development  and  use  of  an  EM3  type  model  at  the  DSARC  0 mile- 
stone. The  major  improvement  provided  by  this  model  as  com- 
pared to  the  EM2  is  the  Introduction  of  engineering  Judgments 
with  regard  to  the  physical  characteristics  of  a proposed 
aircraft  avionics  system.  Undoubtably  some  of  these  Judgments 
could  be  made  by  engineers  even  as  early  as  the  DSARC  0 mile- 
stone but  we  do  not  consider  that  these  Judgments  would  reduce 
model  output  uncertainties  sufficiently  to  Justify  the  use  of 
EM3  at  DSARC  0.  Admittedly  our  conclusion  is  based  on  intui- 
tive Judgments  of  the  nature  of  the  information  required  for 
OSD  decisions  at  the  various  stages  of  the  system  acquisition 
cycle.  Nevertheless,  we  believe  that  the  OSD  decision  at  DSARC  0 
would  not  be  sensitive  to  the  marginal  Improvements  provided  by 
an  EM3  versus  EM2  model  calculation. 
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We  conclude,  therefore,  that  an  EM2  model  capability  is 
adequate  for  OSD  at  DSARC  0 and  actions  should  be  taken  to 
achieve  such  a capability. 

C.  POINT  ESTIMATE  METHODS  FOR  OSD  USE  AT  THE  DSARC  I MILESTONE 

In  this  section  we  consider  methods  that  should  be  used  at 
the  critical  DSARC  I milestone.  As  discussed  earlier  a very 
large  percentage  of  the  ultimate  support  costs  to  be  incurred 
on  an  avionics  system  will  be  determined  by  the  decisions  made 
at  DSARC  I. 

Although  the  suitability  of  the  major  system  under  consid- 
eration remains  to  be  demonstrated,  by  DSARC  I the  Service 
has  determined  the  major  characteristics  of  the  desired  system. 
Our  conversations  with  contractors  have  led  us  to  conclude  that 
sufficient  information  on  the  characteristics  of  the  avionics 
equipment  on  a proposed  aircraft  is  available  by  DSARC  I to 
permit  the  use  of  support  cost  estimating  methods  with  signi- 
ficantly less  uncertainty  in  the  outputs -than  at  DSARC  0. 

1 . Tools  to  Provide  Minimum  Required  OSD  Capability 

The  EM3  model  offers  the  greatest  promise  for  satisfying 
the  minimum  capability  required  by  OSD  at  DSARC  I.  This  model 
must  have  the  inputs  of  engineering  Judgments  with  regard  to 
physical  characteristics  of  the  avionics  equipment  and  the 
selection  of  analogous  equlpinent  from  the  historical  data  base. 
Since  the  avionics  equipment  is  to  be  identified  only  to  the 
two-digit  WUC  level,  these  engineering  Judgments  are  required 
for  a limited  number  of  equipment  components. 

Considering  the  importance  of  the  support  cost  variables 
in  decisions  on  major  systems  acquisition,  it  seems  reasonable 
for  OSD  to  have  direct  access  to  a support  cost  data  base 
built  through  the  use  of  information  produced  by  the  Navy  VAMOSC 


system  and  AFLC  logistic  systems.  With  such  a data  base  and 
application  of  a limited  number  of  engineering  Judgments,  OSD 
could  prepare  point  estimates  that  would  be  sufficiently  accu- 
rate for  an  independent  DSARC  I analysis.  Certainly  these 
estimates  would  be  sufficiently  accurate  to  permit  a reasonable 
dialogue  with  the  sponsoring  Service  on  possible  costs  to  be 
incurred  by  a proposed  system. 

2 . Tools  to  Provide  Enhanced  OSD  Capability 

OSD  capability  for  developing  point  estimates  Independently 
could  be  enhanced  by  adoption  of  the  EM5  model.  Although  the 
conceptual  approach  of  this  model  is  the  same  as  EM3,  the  number 
of  variables  is  significantly  larger.  More  engineering  Judg- 
ments would  be  required  to  use  the  EM5  approach  which  should 
reduce  the  degree  of  uncertainty  in  the  outputs. 

The  APLC  Logistic  Support  Cost  Model,  the  Navy  LCC  model, 
or  the  CRIER  model  could  be  used  by  the  Services  in  developing 
avionics  support  cost  estimates  for  their  DCPs  submitted  for 
DSARC  I decisions.  Engineering  Judgments  would  be  required  for 
many  of  the  Inputs  but  we  consider  this  procedure  to  be  quite 
feasible.  Although  these  models  are  too  cumbersome  for  use  at 
the  OSD  level  in  preparing  Independent  estimates,  the  provision 
of  Service  estimates  generated  by  these  models  would  be  useful 
for  Service  and  OSD  dialogues  on  support  costs. 

For  the  largest  of  the  major  system  acquisition  programs 
we  believe  it  is  reasonable  to  require  the  Services  to  produce 
EMI-type  support  cost  estimates.  The  contractors  involved  in 
system  studies  prior  to  DSARC  I can  produce  such  estimates 
and  they  should  be  made  available  to  OSD  for  the  review 
process . 

To  summarize  at  DSARC  I,  OSD  Independent  avionics  support 
cost  analyses  should  be  performed  by  use  of  EM3-type  models. 
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The  Services  should  be  required  to  submit  cost  estimates  based 
on  either  EM4-  or  EMI-type  model,  based  on  the  size  of  the 
proposed  system  acquisition  program. 

D.  OSD  METHODS  FOR  USE  AT  THE  DSARC  II  MILESTONE 

At  the  DSARC  II  milestone,  source  selection  has  been 
accomplished  and  the  Service  is  prepared  to  move  into  full- 
scale  development  on  the  proposed  weapon  system.  In  our  view 
most  of  the  equipment  level  decisions  have  been  made  by  DSARC 
II  and  the  bulk  of  the  final  avionics  support  costs  have  been 
determined.  Cost  savings  can  be  enjoyed  by  later  actions  but 
they  are  at  the  margin  and  merely  represent  a "honing"  of  the 
systems  to  achieve  maximum  efficiency  and  effectiveness.  We 
see  no  reason  why  OSD  should  accept  less  than  an  EMI-  or  EM^- 
type  model  output  from  the  Services  at  this  time. 

For  independent  OSD  estimating  we  suggest  the  use  of  the 
EM5-type  model  or,  as  a minimum,  the  EM3.  We  recognize  that 
the  EM5  model  could  Involve  considerable  research  to  secure 
the  necessary  input  variables.  On  the  other  hand,  directives 
with  formats  could  be  developed  requiring  the  Services  to  pro- 
vide all  of  the  input  information  needed  to  use  the  model. 

In  our  view  a fairly  comprehensive  method  must  be  used 
for  any  Independent  estimates  prepared  for  DSARC  II.  By  this 
time  the  hardware  components  are  sufficiently  defined  that  the 
outputs  of  broad  parametric  methods  would  be  of  very  limited 
value.  The  Service  and  OSD  dialogue  should  Involve  component-type 
reviews  whereas  the  value  of  the  parametric  methods  is  that 
they  provide  "ball-park"  system-type  estimates. 

E.  TOOLS  FOR  OSD  USE  IN  CONDUCTING  AVIONICS  COMPONENT 

TRADE-OFF  ANALYSES 

This  section  addresses  the  question  of  support  cost  esti- 
mating methods  that  might  be  useful  in  conducting  trade-off 
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analyses  on  Individual  avionics  equipments  such  as  fire  control 
radars . 

Our  task  order  required  us  to  review  Industry  and  Service 
data  and  management  systems  to  determine  the  extent  to  which 
they  contain  high-cost  avionics  subsystem  data.  As  stated 
elsewhere  in  this  paper  we  believe  that  the  Navy  VAMOSC  data 
base  contains  suitable  data  to  use  in  addressing  questions 
related  to  individual  avionics  component  support  costs.  In  the 
Air  Force  the  IROS  system  provides  useful  information  for 
this  type  of  analysis  although  we  are  not  satisfied  that  the 
IROS  system  encompasses  all  of  the  base  and  depot  costs  that 
should  be  considered. 

To  provide  OSD  with  a suitable  capability  to  conduct 
avionics  component  trade-off  studies,  the  first  step  is  to  cre- 
ate a data  base  of  the  kind  required  to  support  an  EM3-type 
model.  However,  the  data  base  should  include  Information  at 
the  5-digit  as  opposed  to  the  2-digit  WUC  level.  Such  a data 
base  would  include  support  cost  Information  on  a long  list  of 
avionics  components  for  which  physical  data  characteristics 
would  also  be  available.  Regression  equations  at  the  5-digit 
WUC  level  in  an  EM3  model  should  provide  a suitable  capability 
to  conduct  trade-off  analyses.  In  some  instances  it  might  be 
necessary  to  exercise  Judgment  on  analogous  systems. 

The  key  to  success  with  the  EM3  model  is  the  development 
of  a reasonably  accurate  data  base  and  conduct  of  high  quality 
statistical  analyses.  As  stated  elsewhere,  we  believe  this  is 
feasible  assuming  sufficient  resources  are  applied  to  the  task. 

F.  CONCLUSION 

In  this  chapter  we  have  provided  our  recommendations  on 
the  best  avionics  support  cost  estimating  methods  for  OSD  to 
use  at  the  DSARC  0,  I,  and  II  milestones. 
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We  consider  it  very  feasible  to  develop  and  use  these 
methods;  in  fact,  we  consider  it  essential  if  OSD  is  to  imple- 
ment its  policies  of  incorporating  life  cycle  costs  as  an 
important  independent  variable  in  the  major  system  acquisition 
process.  Furthermore,  we  consider  that  these  methods  should 
be  developed  and  used  as  evidence  that  OSD  is  serious  about 
the  importance  of  these  life  cycle  cost  variables.  A thorough 
and  vigorous  effort  to  pursue  the  support  cost  estimating 
problem  would  be  a major  step  in  establishing  and  maintaining 
credibility  with  the  defense  contractor  community  in  this 
regard . 

In  some  of  the  proposed  models  engineering  Judgement  Inputs 
are  required  to  permit  the  models  to  produce  the  desired  out- 
puts. These  Judgements  should  be  available  to  OSD  from  various 
sources  including  the  Services  and,  perhaps,  the  OSD  staff. 

In  some  cases  it  might  be  necessary  or  more  appropriate  to 
secure  assistance  from  independent  contractor  sources.  Con- 
sidering the  assumed  importance  of  the  support  cost  variables 
in  OSD  decision-making,  it  is  clearly  reasonable  to  expend 
sufficient  resources  on  professional  assistance  to  assure  that 
the  best  possible  outputs  are  obtained  from  OSD  estimating 
methodologies . 

Models  are  abstract  representations  of  reality  and  will 
always  produce  uncertain  outputs.  These  outputs  are  useful  in 
assessments  of  order-of-magnitude  and  relative  values.  We 
believe  that  in  the  DSARC  process  these  outputs  should  be 
augmented  by  detailed  OSD-level  engineering  and  cost  analyses 
of  estimates  and  their  associated  variables  produced  by  the 
Services  and  contractors  in  supporting  their  DSARC  submissions. 
These  analyses  should  be  thoroughly  and  objectively  performed. 
Considering  the  importance  of  these  major  programs  and  the  time 
required  to  develop  estimates  in  the  Services  and  review  them 
at  the  OSD  level  we  believe  it  is  reasonable  for  OSD  to 


209 


conduct  in-depth  line  item  type  reviews  of  Service-submitted 
support  cost  estimates.  These  reviews  would  be  designed  to 
ensure  that  the  best  Judgments  and  best  data  have  been  used  in 
developing  the  variables  and  producing  the  outputs  that  will 
be  so  important  in  decision-making. 


